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Professionals working in the early childhood-special education field can no 
longer afford to overlook the importance of evaluation. First, future continuation 
and expansion of early intervention programs might depend, in part, on documented 
efficacy data. Second, evaluation is essential in order to develop and monitor 
effective educational programs for young handicapped children. As Evans (1982) 
cogently states ..." educators live in the age of an evaluation imperative 11 (p. 
1). 

In the last 10 to 15 years there has been an increase in the number of 
intervention programs and services available to handicapped children from birth to 
three. To some extent, the proliferation of programs and services has been the 
result of federal legislation and fiscal support. For example, when congress 
established the Handicapped Children's Early Education Program in 1968, the number 
of demonstration projects for handicapped preschool children increased from 24 to 
150 in less than a decade. Likewise, funds for these programs increased from one 
to 22 million dollars during this time period (Swan, 1980). 

Although educational and related services were not necessarily guaranteed, 
federal legislation provided incentives to states for the provision of services for 
preschool handicapped children. For example, many states have taken advantage of 
federal funding to develop a variety of services (e.g., child find and pavent 
training programs) for preschool handicapped children. Others have established 
policies to ensure that services are available for preschool handicapped children. 
For example, programs and services are mandated at preschool-age in many states and 
at birth in some states (Cohen, Semmes, & Guralnick, 1979). 

During the 1960s and 1970s pol icies (e.g., legislation) and fiscal support 
established at the federal, state, and local levels was, in part, responsible for 
the increase in number of programs and services for handicapped children from birth 
to three. However, times are changing. The fiscal boom of the last two decades is 
waning and the political climate is changing. Changing state tax legislation 
(e.g., Proposition 13 in California), a decrease in public confidence concerning 
education (Hymes, 1982), and the current administration's "new federalism 11 
policies, such as state educational block grants (Takanishi & Feshbach, 1982), are 
some of the factors contributing to a growing decline in fiscal and legislative 
support for educational programs. 

A decrease in fiscal and legislative support has potential ramifications for 
future programs and services for handicapped children. Existing programs face 
drastic budget cuts and the possibility of needing alternative funding sources 
(e.g., private foundations). Obtaining resources for the development of new 
programs is even more questionable. As educational resources become scarce, 
intervention services for handicapped infants and preschool children will be 
subject to scrutiny by legislators, funding agencies, and tax payers (Evans, 1982). 
More than ever before documented evidence regarding the efficacy of early 
intervention may be necessary to justify the expenditures for the continuation and 
expansion of programs and services for handicapped children from birth to three. 

Not only might evaluation be crucial for the existence of future early 
intervention programs, but evaluation is essential for appropriate and effective 
intervention (Bricker & Littman, 1982). The purpose of most early intervention 
programs, is to target areas where children need remediation (e.g., communication 
training) and then facilitate the acquisition of necessary skills and functional 
behaviors. To determine if intervention efforts are appropriate and effective, 
there should be a link between intervention practices and decision making based on 
objective information that will aid decision making. For example, if children are 
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not making progress towards target objectives, then modifications cr changes can be 
made in intervention plans (e.g., IEP goals, training objectives). Through 
systematic and on-going evaluation timely programmatic decisions can be made 
enabling more appropriate and effective intervention practices. 

Objective information is also important in order to judge the overall value of 
an intervention program. Systematic evaluation provides the information to 
determine if children are making acceptable progress that might be, in part, 
attributable to specific interventions. 

Evaluation is essential in order to provide appropriate and effective programs 
for young handicapped children and to demonstrate the value of early intervention. 
The need to monitor intervention practices and demonstrate the efficacy of early 
intervention has created a need for feasible and valid evaluation methodology. 
However, methodological problems (e.g., lack of appropriate controls, limited 
applicability of statistical procedures) make evaluation efforts with young 
handicapped populations difficult at best. In addition to methodological problems, 
evaluation efforts in early intervention programs are rarely guided by any formal 
evaluation plans or approaches (Sheehan & Keogh, 1982). A major problem 
confronting those who plan and evaluate early intervention programs is tht- lack of 
available approaches or systems to guide intervention and evaluation activities 
(DuBose, Langley, & Stagg, 1977; Switzky, Rotatori, Miller, & Freagon, 1979; 
Bricker, Sheehan, & Littman, 1981). A major question that should be addressed by 
professionals in the early intervention field is how to provide appropriate 
intervention programs and demonstrate the efficacy of intervention efforts. 

Linking Intervention and Evaluatio n 

The need to demonstrate the efficacy of early intervention for young 
handicapped children has created a need for systematic methods or strategies to 
plan and evaluate early intervention practices. Planning appropriate and effective 
intervention programs requires that evaluation be an integral part of intervention. 
Evaluation methods and strategies that have been recommended by educators who work 
with young handicapped children often emphasize the interdependent relationship 
between intervention and evaluation. For example, Bricker and Littman (1982) 
claiming that "Evaluation is essential for effective intervention 1 ' (p. 23), 
describe a detailed system that links evaluation activities with intervention 
practices. Their evaluation system includes three separate but interrelated 
levels: 1) initial assessment and programming, 2) on-going monitoring, and 3) 
annual program evaluation. The evaluation process is implemented at the beginning 
of the school year or when children erter the program and continue until the end of 
the year or when children leave the program. Initial assessment provides 
information to formulate Individual Education Plans (IEP) and instructional 
programs and strategies. On-going monitoring (i.e., daily /weekly instructional 
data and quarterly assessment) enables timely programmatic modifications or changes 
for individual children based on objective information. Annual evaluation provides 
information about the overall effectiveness of instructional plans and strategies 
for individual children, sub-groups of children (e.g., children with certain 
handicapping conditions or ages), and/or the total group of children enrolled in 
the program. 



The potential outcome of the evaluation system suggested by Bricker and 
Littman (1982) is the effective integration of evaluation and intervention. 
Similarly, others recommend systematic approaches to evaluation and intervention 
(DuBose, Langley, & Stagg, 1977; Bagnato, 1981; Bagnato & Neiswortli, 1981; Bricker, 
Seibert, & Scott, 1978) which require assessment as one necessary ingredient for 



ERIC 




the successful integration of evaluation and intervention. 

Perhaps assessment is the process that "links 11 evaluation and intervention and 
an assessment instrument s) or test(s) is the mechanism that enables the linkage. 
To be useful for both intervention and evaluation purposes when dealing with young 
handicapped children, assessment should target exact functioning levels; suggest 
intervention goals and- training objectives; monitor child progress; and provide 
program evaluation information. Not only should assessment instruments be designed 
to assess skills and capabilities across several curricu'ar or developmental areas 
(e.g., motor, cognition, language, and social), but the content of the 
instrument (s) should closely match the content and objectives of the intervention 
program and contain items that represent small sequential steps in order to reflect 
small gains or treatment effects' (Sheehan, 1982). However, the majority of 
existing instruments do not adequately assess young handicapped children and 
information from existing instruments has limited usefulness fur educational 
programming and evaluation purposes. One plaguing problem for those who plan and 
e v aluate programs for young handicapped children is the inadequacy of available 
measurement instruments (White & Haring, 1978; Bricker & Sheehan, 1981; Hamilton & 
Swan, 1981; Sheehan & Keogh, 1981; Bricker & Littman, 1982; Simeonsson, Huntington, 
& Short, 1982). 

Assessment of Handicapped Infants and Preschool Children: 
Limitations of Existing Instruments 

One reason it is difficult to assess handicapped children with existing 
instruments is the administration procedures required by these instruments. Tests, 
such as the Bayley Scales of Infant Development and Cattell Infant Intelligence 
Scale, are typically given in isolated settings by a trained examiner, testing one 
item at a time. Testing in unfamiliar settings by strangers can repress children 1 s 
responses (DuBose, 1979; Yarrow, 1979) and testing one item at a time might provide 
a limited view of children's abilities and capabilities (DuBose, Langley, & Stagg, 
1977). In addition, skills exhibited during a structured assessment (e.g., use of 
standardized procedures) will not necessarily appear in children's spontaneous 
behavior (Simeonsson & Wiegerink, 1975; Anastasiow, 1979; Fischer, 1980). 
Assessing children as they routinely behave in various environments might increase 
the likelihood of differentiating functional and nonfunctional skills. More 
information might be obtained by an interventionist assessing a child in a natural 
setting (e.g., home, classroom) while participating in routine activities. For 
example, a child might produce functional fine motor and language skills during 
snack time that might not occur during a direct test (.i.e., structured) situation. 

Besides an appropriate setting, some handicapped children often need special 
materials (Filler, 1973; Bricker & Littman, 1982) or adaptations in test procedures 
(Simeonsson & Wiegerink, 1975; White & Haring, 1978; DuBose, 1981) to correctly 
perform certain tasks or behaviors. However many tests, such as the Bayley Scales 
of Infant Development and Stanf ord-Binet Intelligence Scale, require specific 
materials and do not allow procedural modifications. A deaf-blind child might need 
practice and physical assistance to understand a test direction. A motorically 
impaired child might need a prosthetic device to complete a task, or a longer time 
to respond than many tests allow. Without special materials or procedural 
modifications, performance levels of many handicapped children might appear to be 
lower than they actually are. Inaccurate information about performance levels 
might result in the selection of inappropriate intervention goals and objectives 
leading to programs geared below the child f s actual competencies and capabilities. 

Not only are flexible administration procedures necessary to adequtely assess 
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handicapped preschool children, but intervention programs need assessment 
instruments that are comprehensive. Most intervention programs deal with many 
areas of development in their curricula (o.g., gross and fine motor, cognitive, 
social interaction, self-care, and communication). Yet, some tests only assess 
limited areas. of development. For example, the Ordinal Scales of Psychological 
Development (Uzgiris & Hunt, 1975) only assess sensorimotor skills. Although this 
test might be administratively appropriate for the handicapped, it would not be 
useful alone for many programs because of its limited scope (i.e., focused only on 
the sensorimotor domain). Some instruments such as the Uniform Performance 
Assessment System (UPAS) (White, Edgar, Haring, Affleck, & Hayden, 1980) and the 
Student Progress Record (SPR) (Oregon State Division of Mental Health, 1977) are 
criterion referenced tests that do assess a wide range of development, but they 
contain a limited number of items for children under three. Assessment instruments 
that assess many domains of behavior and contain items that cover the 
birth-to-three age range are needed. 

Standardized or norm referenced tests summarize performance into single total 
scores, giving limited information for educational planning. For example, the 
overall score from the Gesel? is converted into a total Maturity Age (MA) score. 
This single MA score does not reflect how a child performed, or did not perform 
certain behaviors. In addition, many tests do not reflect actual performance 
because the converted score tables do not include scores that fall below certain 
levels (Simeonsson & Wiegerink, ? 975; White & Haring, 1978); for example, a 
developmental quotient (DQ) can not be calculated for a score below 50 on the 
Bayley. Total or derived scores might suggest delayed areas of functioning (e.g., 
motor and cognition) but these scores do not give enough information to determine 
program objectives or training strategies (Darby, 1979; DuBose, 1981; Ramey, 
Campbell, & Wasik, 1982). 

Scores derived from criterion referenced tests can also be limited. Many 
criterion referenced tests contain items and corresponding age levels from several 
standardized tests. Not only do age level scores provide limited information for 
educational planning, but because these scores were derived from different 
standardized samples they may provide an unreliable estimate of performance or 
developmental level (Johnson, 1982). 

Comprehensive assessment instruments that are sensitive to small changes in 
development and relevant to intervention objectives are needed for program 
evaluation. As mentioned before the liPAS and SPR are comprehensive, yet lack items 
appropriate for children under three. It is diffi^U to measure small 
developmental gains of handicapped preschool children with instruments that do not 
contain items that measure small developmental increments. Standardized or norm 
referenced tests (e.g., Bayley) are designed to assess global abilities and will 
not adequately reflect small changes in child behavior (MacTurk & Neisworth, 1978; 
Sheehan, 1980; Garwood, 1982). In addition, the purpose of standardized tests is 
to compare a single child's performance against the performance of the norm sample. 
Comparing handicapped children with nonhandicapped children might give some 
information about, performance in relation to the norm performance; however, such a 
comparison does not give either information about individual achievements nor the 
impact of specific intervention strategies that were used in the program. To 
measure program effectiveness, assessment instruments must be relevant to the 
objectives of the program — they must measure what programs try to accomplish 
(Bricker, Seibert, & Scott, 1978; Kopp, 1979; Ramey, Campbell, & Wasik, 1982). 

In summary, the majority of existing assessment instruments do not adequately 
assess young handicapped children, and the information from these instruments has 



limited usefulness for educational programming and evaluation purposes. The 
usefulness of assessment instruments for planning educational programs (e.g., 
training objectives) and evaluating program effectiveness depends on the objectives 
of the intervention program and the characteristics of the children in the program 
(Bricker & Li.ttman, 1982 ) . However, regardless of pugram objectives and 
population characteristics, assessment should target exact functioning levels; 
suggest intervention goals and training objectives; monitor child progress; and 
provide program evaluation information. To be appropriate for handicapped infants 
and preschool children and to provide useful programming and evaluation 
information, an assessment instrument should meet certain criteria (Bricker, 
Seibert, & Scott, 1978; DuBose, 1981). An assessment instrument for monitoring 
child progress and program evaluation should: 

1. Be used by those people who deal with the child on a regular basis 
(i.e., teachers, aides or parents) in a natural setting (i.e., home, 
classroom) . 

2. Reflect curricular content of the intervention program; objectives 
that might be used as training targets should be included in the 
instrument. 

3. Provide a logical developmental sequence of items or objectives that 
can be used as training guidelines. 

4. Accommodate a wide range of handicapping conditions. 

5. Specify performance criteria that indicate if a child has a 
particular skill and if the skill is a functional part of the child's 
daily repertoire. 

6* Be a reliable and valid measure. 

In their review of prominent assessment instruments developed for infants and 
preschool children, Bagnato and Neisworth (1981) found few instruments that meet 
the final criterion suggested for a useful instrument. Likewise, ethers report the 
majority of available instruments lack reliability, validity, and standardization 
data (Walls, Werner, Bacon, & Zane, 1977; Cross & Johnston, 1977; Johnson & Kopp, 
undated). The limitations of existing instruments (including the lack of 
psychometric data) and pressing demands for accountability, has created an uigent 
need for assessment instruments suitable for young handicapped children and useful 
for intervention and evaluation purposes. 

One instrument that holds some potential for meeting the criteria suggested by 
Backer, Seibert, and Scott (1978) and DuBose (1981) is the Comprehensive Early 
Evaluation and Programming System (CEEPS). The CEEPS is an experimental 
criterion-referenced instrument developed for handicapped children from birLh to 36 
months. This instrument was designed to: 1) provide specific information thai, can 
be used to develop program objectives across a range of developmental areas; and 2) 
be used as a tool to assess program effectiveness. 

The Comprehensive Early Evaluation and Programming System (CEEPS) 1 

The CEEPS was designed to be used by direct service personnel (e.g., teachers, 
therapists) by observing children in daily-living environments (e.g., home, 
classroom). The preferred method of assessment is observation of the child in 
her/his environment. However, if observation does not provide adequate information 
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1 The CEEPS is a revision of the Adaptive Performance Instrument (API) which was 
developed by the Consortium on t Adaptive Performance Evaluation (CAPE, 1978). 
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or a child does not display certain behaviors, direct testing or report (e.g., 
parent report) are allowed. 

The CEEPS is educationally relevant. The items in the test reflect curricular 
content appropriate for most early intervention programs. There are six curricular 
areas called Domains included in the CEEPS: Gross Motor, Fine Motor, Self-Care, 
Cognitive, Social, an<J Communication. Each of the six domains are composed of a 
series of Strands which represent groups of related behaviors within a domain. For 
example, the cognitive domain contains seven strands: Sensory Stimuli, Object 
Permanence, Imitation, Causality, Problem Solving, Object Differentiation, and 
Pre-Academic Skills. Each strand is divided into a series of items called Long 
Range Goals (LRG) ard Training Objectives (TO). The TOs are arranged in steps 
beginning with the simplest response and moving to a specific LRG (i.e., the most 
difficult response). Failed TOs can be selected as short-term IEP objectives and 
failed LRGs can be selected as long-term IEP goals. 

Long range goals and training objectives are arranged in a sequence that 
reflect either a developmental and/or a hierarchical training progression. 
Developmental research and theory, as well as component task analysis, directed the 
selection and sequencing of assessmsnt items in each domain. 

The CEEPS Administration Manual contains a detailed description of the 
assessment procedure (i.e., observation and direct test procedures); necessary 
equipment and materials; and the criteria for successful completion of each LRG and 
TO. Each item (i.e., LRG and TO) is scored either pass (+) or fail (-) in the 
n score boxes 11 on the CEEPS data recording forms. Codes that describe specific 
types of responses (e.g., direction adaptation) are recorded on the "notes" column 
next to the score. The number of correct responses is tallied for each domain and 
the raw score can be converted to a percentage correct score (i.e., total 
percentage domain scores). 

The CEEPS was designed to accommodate a range of handicapping conditions. 
Adaptations are permitted for children who have sensory or motoric handicaps that 
might restrict their ability to perform a target behavior. Two types of 
adaptations can be made: direction adaptations and criterion adaptations. 
Direction adaptations are changes in the materials, position of the child, or 
presentation of the items. For example, a physically handicapped child might need 
a spoon with a built-up handle to facilitate eating or a hearing impaired child 
might require sign language to understand a specific direction. Criterion 
adaptations are changes in the acceptable response format; for example, changes in 
the rate of performance or the type of performance. A visually impaired child 
might not be able to focus on an object manipulated by an adult but would pass the 
item if the criteria were changed to accept postural orientation to the adult. A 
physically handicapped child who cannot produce speech sounds could respond 
correctly by pointing to symbols on a communication board. 

Performance standards were designed to indicate if a child has a particular 
skill or concept and if the skill/concept is functional for daily living. The 
CEEPS has different scoring levels that indicate if a skill/concept is consistently 
exhibited across people and settings; situation specific (e.g., only exhibits 
skill/concept with certain people); or inconsistently produces (i.e., exhibits 
skill/cpncept sometimes and not other times). The CEEPS discriminates levels of 
skill performance between those behaviors that can be performed but are not used 
functionally by the child and those behaviors that are performed in a functional 
manner. (Appendix A contains selected information on the CEEPS.) 
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Purpose of the Study 

The final criterion suggested for a useful instrument is that it be a reliable 
and valid measure. The purpose of this study is to provide information on selected 
psychometric properties of the Comprehensive Early Evaluation and Programming 
System (CEEPS). The primary focus of this study will permit evaluation of its 
reliability, validity^ and utility. Following are the specific research questions 
addressed in this study. 

Research Questions 

Reliability 

1. what is the agreement when two observers simultaneously observe the 
same children and rate (pass-fail scores) children's performance on CEEPS 
items? 

2. What is the agreement between scores if the CEEPS is administered 
twice to the same children with a brief time period between 
administrations? 

3. Are CEEPS items logically organized into domains which represent 
different constructs oi groups of behaviors? 

4. What is the agreement between scores obtained by observation and 
scores obtained by direct test when the CEEPS is administered to the same 
children using both methods of assessment (observation and direct test)? 

Validity 

1. What is the relationship between CEEPS scores and standardized test 
scores and clinical judgement of children's abilities? 

Utility 

1. To what extent is the CEEPS a feasible and useful assessment 
instrument? 

METHOD 

The CEEPS is an experimental assessment instrument for which data are needed 
to examine its reliability, validity, and usefulness. The purpose of this study 
was to provide information on selected psychometric parameters of the CEEPS that 
will permit evaluation of its reliability and validity. In addition, this study 
examined the instruments 1 usefulness for developing educational programs for 
handicapped preschool children. 

Subjects and Setting 

The children enrolled in the Early Intervention Program (EIP) at the Center on 
Human Development, University of Oregon participated in this study. There were 22 
handicapped children between the ages of 24 and 40 months (mean, 30,7; sd, 4.4) and 
10 nonhandicapped children between the ages of 20 and 39 months (mean, 29.7; sd, 
7.5). The handicapped children were diagnosed as having a variety of disabilities 
including: general developmental delays, Down syndrome, and motoric disorders. 
Impairments ranged from at-risk for developmental problems, mildly delayed to 
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moderately and severely impaired. 

The children attended class at the center four days a week for 
two-and-one-half hours a day. Observation data were collected by observers in the 
classroom and the CEEPS was administered by the intervention staff in the 
classroom. The Gesell was administered by a trained examiner in the testing room 
at the center. Parents completed a rating form of children's skills and abilities 
prior to the Gesell administration (i.e., in the testing room) and parent 
interviews were conducted in a convenient location at the center (e.g., office, 
family living area). 

Measures 

The CEEPS Administration Manual and data recording forms were used when the 
instrument was administered to the children by the intervention staff and when 
observers collected data for reliability purposes. Most of the test materials were 
toys, objects, and containers found in the classroom. (Selected information from 
the administration manual can be found in Appendix A.) 

The Gesell Developmental Scales Test Kit, Administration Manual and required 
test materials were used when the Gesell was administered. Test data were recorded 
on Gesell Protocal Forms (see Appendix B). 

A parent rating form was used to collect data concerning parent judgements 
about their children's skill levels and abilities. This rating form contains CEEPS 
Long Range Goal (LRG) items rewritten in language appropriate for parents (i.e., 
removing technical jargon). Parents respond to each item by checking whether their 
child exhibits a certain behavior: All the Time, Used To, Sometimes, or Not Yet 
(see Appendix C). 



The Developmental Profile 11 (Rev. ed. ) (Alpern & Shearer, 1980) was also used 
to obtain information from parents regarding their children's skills and abilities. 
This instrument contains developmentally sequenced items across five major areas 
(Physical, Self-Help, Social, Academic, and Language) and is administered by 
interviewing parents. Parents respond to selected items (questions) by indicating 
whether their child can (Yes) or cannot (No) perform a certain skill or behavior. 
(Selected information from thfc administration manual and an example data recording 
form can be found in Appendix D.) 



Procedures 



Observers and Observer Training 



Three observers (not part of the intervention staff) collected data to 
determine interobserver and test-retest reliability for the CEEPS. Observers were 
systematically rotated so that each collected both interobserver and retest data. 
Prior to data collection the investigator conducted a training session which began 
after the observers had an opportunity to read the CEEPS Administration Manual and 
reviewed the data recording forms. 



Training Procedures 

Videotapes of nonhandicapped children not included in the study were used for 
training the observers. To give observers the opportunity to "practice" observing 
and scoring items across a range of skill/developmental levels children were 
videotaped who were six, 12, 16, and 30 months of age. 

jER£ . 13 




9 



The three observers viewed each tape and scored each item for each CEEPS 
domain (fine motor, gross motor, cognitive, self-care, social, and communication). 
Items for specific domains were scored as relevant behaviors were seen on the 
tapes. For example, a cluster of fine motor behaviors might have been observed 
before all items in the cognitive domain were scored. In this case the observers 
switched from the cognitive domain to the fine motor domain and scored the 
pertinent fine motor items. Or, children might have exhibited communication and 
cognitive skil ls/beKaviors at the same time. The observers then scored the 
appropriate items for both domains. As necessary, the videotapes were replayed 
during each observation session to score those items that were missed. Observers 
recorded scores on the CEEPS data recording forms using the scoring decision rules 
found in Appendix E. 

Twelve training sessions, approximately one hour each, were conducted. Four 
sessions involved discussions (e.g., clarifying items and/or criteria) and eight 
sessions involved observing the videotapes and scoring CEEPS items. By the end of 
the eighth session at least 80 percent agreement was reached for items scored by 
the observers for each CEEPS domain. 

Interobserver Reliability 

Although "direct test 11 and "report" are allowed methods of data collection for 
the CEEPS, the preferred method of data collection is observ >n. This instrument 
was designed to be used by a variety of direct service personnel (e.g., teachers, 
assistants, therapists) while observing children in routine daily living settings 
(e.g., classroom, home). The extent to which the CEEPS is a reliable observation 
instrument was examined. 

Two observers simultanously observed the same child and scored CEEPS items 
using the data recording forms. Using total domain scores (i.e., total number of 
items scored pass), score consistency (reliability) was determined for the total 
test and for each domain separately; 1) across subjects (i.e., handicapped and 
nonhandicapped) , and 2) for the handicapped group of children. 

Scheduling Procedures 

The children were observed during the normal school day. Each child was 
observed for one day for approximately one-and-one-half hours. Observations began 
afte.r the observer training was completed and continued for approximately 14 weeks. 

All children in the EIP are assigned an identification (ID) number as soon as 
they are enrolled in the program. Children were observed consecutively in order of 
their ID numbers (e.g., number 271 was observed first, number 272 was observed 
second). When a child was absent, his/her name was placed at the end of the list 
and the next child was observed instead. When new children were enrolled in the 
program, their names were placed at the end of the list. 

Observation Procedures 

Two observers viewed each child in the classroom while she/he participated in 
routine activities (e.g., play time, activity groups, snack time). As the child 
changed activities, observers followed the child to ensure they were close enough 
to see and hear the child. 

Observers scored items for specific domains as relevant behaviors were seen. 
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For example, items in the Eating Strand, Use of Utensils Strand (Self-Care domain), 
and the Interaction Strand (Social domain) might have been scored during snack 
time. In some situations it might have been appropriate to score items only in one 
particular domain. For example, items in the Gross Motor domain might have been 
scored during. gross mo^or activities or free play time. The order of scoring 
domains and/or strands was left to the discretion of each observer. 

The observers did not discuss data collection procedures (e.g., scores for 
items, children's performance) during the entire data collection period (i.e., for 
approximately 14 weeks). Each observer kept the CEEPS recording forms on a 
clipboard. At the end of each day (observation session) the investigator collected 
the clipboards and returned the clipboards to the observers the next day. The 
investigator collected and stored all completed data recording forms for the data 
analysis . 

To ensure that procedures were correctly followed the investigator was present 
for the majority of observations and available to assist the observers (e.g., 
answer procedural questions). In addition, the investigator periodically checked 
the data collection forms for individual subjects and determined percent of 
agreement for items scored in each domain. 

Data Collection Procedures 

Children 1 s performance was scored either pass 0+) or fail (-) for each item in 
the CEEPS. Scores were recorded in the score box on the data recording forms. In 
a few cases observers did not have the opportunity to observe certain behaviors 
(e.g., the situation did not allow children to exhibit certain behaviors). When 
observers did not have the opportunity to observe certain behaviors the pertinent 
items were scored fail (-) and a "NO" (no opportunity) recorded in the "notes" 
column on the data recording forms. Scoring conditions and codes are explained and 
defined on the Scoring Decision Rules Sheet (Appendix E). The observers used these 
decision rules as guidelines for scoring. 

Test-Retest Reliability 

Test-retest reliability is the method for determining temporal stability of a 
measure (Anastasi, 1976). If a child is given the same test twice, with a brief 
time period between administrations, the scores should be similar for both 
administrations if the test is reliable. Test-retest reliability was examined to 
determine if CEEPS scores are consistent or reliable. 

Scheduling Procedures 

To prevent or restrict other factors such as intervention or maturation from 
causing a change in test scores (Sax, 1930) a one to two week test-retest interval 
was used. 

Children (N=28) were observed according to the date of the first 
observation — that is, those children observed during the first week of 
interobserver reliability data collection were observed a second time one to two 
weeks later. For example, a child first observed on Monday during the first week 
in March, was observed a second time on Monday during the second or third week of 
March (one to two weeks between observations). A three week interval was allowed 
when children were absent and an exact one to two week interval could not be 
maintained. 
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Observation Procedures 

A third observer collected test-retest data. Scheduling and observation 
procedures described for interobserver reliability observations were also used for 
test-retest observations. 

Data Collection Procedures 

The third observer followed the same data collection procedures previously 
described (e.g., scoring procedures). For test-retest purposes the CEEPS data 
recording forms completed by the two observers collecting interobserver reliability 
data were alternately matched with the CEEPS data recording forms completed by the 
third observer collecting test-r^test data, for example, the first and third data 
recording forms completed by the third observer were matched with the data 
recording forms completed by the first observer; the second and fourth data 
recording forms completed by the third observer were matched with the data 
recording forms completed by the second observer. This alternating sequence 
continued for all observation data recording forms. Because situations were often 
different between the first and retest observations (e.g., available opportunities 
for children to perform certain behaviors), items scored "NO" (no opportunity) by 
any two observers were omitted from the analysis. Agreement between each pair of 
data recording forms was calculated to determine score consistency or test-retest 
reliability. 

Internal Consistency 

If items on a particular test are sequenced in a hierarchy, children who pass 
more difficult items should pass the easier items. Sequential order of test items 
facilitates test administration: if a child passes the more difficult items, then 
it would not be necessary to assess lower level (easier items). Determining the 
extent to which items are in sequential order will assist interventionists in 
targeting exact skills in need of intervention. 

However, due to the nature of items contained in the CEEPS traditional 
procedures to determine item sequence or score consistency (e.g., split-half 
reliability, scalogram analysis) are inappropriate. Each CEEPS domain is divided 
into strands that represent related groups of behaviors. Each strand contains a 
series of items called Long Range Goals (LRG) and Training Objectives (TO). The 
LRG items are thought to be arranged in a hierarchical sequence and assess the most 
complex behaviors associated with a specific group of behaviors in a strand. In 
some strands the TO items assess behaviors prerequisite to more complex behaviors 
(LRG items) and the items are arranged in a hierarchical sequence. In other 
strands the TO items do not assess prerequisite behaviors and are not in a 
hierarchical sequence but rather are thought to be arranged in a parallel fashion. 

In addition, the nature and sequence of development is not uniform across 
children or skill domains. First, as children develop and acquire higher level 
skills they will not exhibit lower level or prerequisite skills. For example, a 
child who is labeling objects may no longer babble. A negative response might be 
reflected in test items for the nonexistent lower level skills. Second, there is 
not one consistent developmental sequence that all children follow. A child will 
not demonstrate the same level of performance across skills but rather, demonstrate 
different skills at different levels at the same time. The variation or unevenness 
across skill domains is a function of environmental influences (e.g., tasks and 
assessment methods) and a variety of different strategies used to perform behaviors 
(Fischer, 1980; Fischer & Corrigan, 1981). Neurological or biological factors 
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(e.g., seizure disorder, Down syndrome) also contribute to variations in skills and 
the sequence of development. 

Scores on the CEEPS may not necessarily conform to a logical developmental 
pattern: that is, items are passed up to a certain point and failed after that 
point. However, examining patterns of successes and failures (pass-fail scores) 
might identify empirical relationships among items suggesting: 1) subsets of items 
within strands and domains that are arranged in a hierarchical sequence; 2) 
sections of the CEEPS in which all items should be administered regardless of the 
item arrangement; 3) items that should be omitted or rearranged within strands or 
domains; and 4) the extent to which domains represent different constructs or 
groups of behaviors. 

Data Collection Procedures 



Performance scores on the CEEPS posttests (Spring, 1983) were used to examine 
the relationship between items within each domain. The CEEPS was administered to 
the children by the intervention staff by primarily observing children as they 
participated in classroom activities. However, direct testing procedures were also 
used (e.g., procedures to elicit a behavior) and some assessment information was 
obtained from the parents (i.e., parent report). 

Method of Assessment Comparison 

Fischer (1980) makes a distinction between structured and spontaneous 
assessment and the type of information or results both methods yield. Structured 
assessment (e.g., use of a standardized test) exposes children to the same 
conditions: the same or similar tasks and standardized procedures. Skills 
exhibited during a structured assessment will not necessarily appear in children's 
spontaneous behavior. Spontaneous assessment involves assessing children as they 
routinely behave in various environments, increasing the likelihood of 
differentiating functional and nonfunctional skills. 

The CEEPS was designed to be used primarily as an observation instrument 
(i.e., a spontaneous type of assessment). A premise of the CEEPS is that 
observation is a more appropriate method to assess children's normally occurring 
and functional behaviors than a more structured assessment (e.g., direct testing 
one skill at a time in an isolated setting). To lend support to the premise that 
observation is a more appropriate and perhaps accurate method of assessment. CEEPS 
scores (for LRG items) obtained by observation as the assessment method and 
direct testing (i.e., structured assessment) qs the assessment method were compared 
to examine the relationship between spontaneous and structured assessment. 

Scheduling Procedures 

A group of handicapped children (N=8) were selected and assessed according to 
the test-retest tfata collection schedule. Data collection began in late April 
while retest observations were taking place and children were assessed according to 
the retest observation list (i.e., consecutively in order of ID numbers). A one to 
two week interval was allowed between the retest observation and the direct test 
assessment. For example, a child who was observed for retest data collection the 
third week in April was assessed by direct test the fourth week in April or first 
week in May (i.e., one to two week interval). 

Data Collection Procedures 
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The CEEPS was administered by a data collector (not part of the intervention 
staff) in the testing room at the center. Each child was assessed during two 30 
minute testing sessions on two different days. Direct testing involved scoring 
each LRG item separately, using standard materials, and using direct test 
procedures found in the CEEPS Administration Manual (an example of these procedures 
can be found in Appendix A). Items were scored either pass (+) or fail (-) and 
recorded on the data recording forms. 

During the CEEPS administration a second data collector simultaneously 
observed the direct test assessment and scored each LRG item. Agreement between 
LRG scores obtained by the two data collectors was determined for each CEEPS 
domain. 

Concurrent Validity 

The concurrent validity of a test indicates the relationship between scores of 
a group of subjects on a particular test and a criterion measure administered at 
the same time or within a brief time period (Borg & Gall, 1979). This study 
examined the relationship between scores on the CEEPS and two criterion measures: 
Standardized test scores and parents' judgements about their children's skill 
levels and abilities. 

Criterion Measures 

The Gesell Developmental Schedules, a parent rating form, and the 
Developmental Profile II (Appendices B, C, and D respectively) were the criterion 
measures. 

The parent rating form was piloted with a group of mothers (N=7) whose 
children did not participate in the study. The purpose of the pilot was to 
evaluate whether the form is appropriate for use by parents. While responding to 
the items, the mothers were asked to evaluate the rating forni for: organization, 
clarity of items, inclusiveness of response categories, and usefulness of examples. 
Generally pilot participants felt the format was organized, items were 
understandable, end examples helpful. Two mothers found some items confusing and 
one mother misunderstood the response category USED TO. 

Based on information from the pilot the rating form was revised (e.g., items 
thought to be confusing were rewritten) and a cover sheet defining the response 
categories (e.g., All the Time, Used To, Sometimes, and Not Yet) was added. 

Data Collection Procedures 

It is important that criterion ratings are not influenced by the rater's 
knowledge of scores obtained on a particular test (Anastasi, 1976). Criterion 
ratings were not obtained from the intervention staff (e.g., teacher judgement of 
children's abilities). Instead, the Gesell was administered by a trained tester 
and judgements (ratings) about children's skill levels and abilities was obtained 
from parents. The tester and each parent were not informed of a particular child's 
CEEPS scores until the tester has completed the Gesell and the parent has completed 
the parent rating form. 

The Gesell was administered at the end of the year (Spring posttest) and the 
CEEPS was administered after the Gesell admininstration (i.e., there was not more 
than a two week interval between administrations of both instruments). 

Hfc . . . is 
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Parents (N=25) were asked to complete the rating form immediately before the 
tester administered the Gesell. The tester reviewed the directions and response 
categories while presenting the form to each parent and gave minimal assistance 
when necessary (e.g., clarified items). The majority of parents were able to 
complete the form independently. 

Parents (N=24) were interviewed using the Developmental Profile II one to two 
weeks before or after the CEEPS administration. Two data collectors (not part of 
the intervention staff) contacted each parent and made arrangements (e.g., 
interview, date, arranged location) to conduct the interviews. Parents were 
interviewed individually and each interview ranged from 30 minutes to one hour in 
length. 



The usefulness of an assessment instrument depends on its "practical" 
attributes as well as its psychometric integrity. The CEEPS was designed to be 
used by direct service personnel while observing children in intervention settings. 
The usefulness of the CEEPS partially depends on the extent to which this 
instrument is suitable for intervention settings and can be successfully 
administered by staff in a reasonable amount of time. 

In addition to practical considerations, a related concern is whether the 
CEEPS is useful to design educational programs. .A stated purpose of the CEEPS is 
to assist interventionists when identifying intervention goals (e.g., IEP goals) 
and developing specific training objectives and strategies. The usefulness of the 
CEEPS depends on whether this instrument accurately reflects performance of young 
handicapped children and provides specific information that can be translated into 
appropriate intervention programs. 

In addition to examining the psychometric properties of the CEEPS, evaluating 
its utility (e.g., administration time) might provide important supplementary 
information about necessary modifications or changes needed in the instrument to 
enhance its practicality. 

Data Collection Procedures 

.Information about the utility of the CEEPS was obtained from the intervention 
staff at the CHD. Staff members (N=4) who had used the CEEPS during the year were 
asked to fill out a form designed to provide evaluative information about the 
CEEPS. (The evaluation form can be found in Appendix F.) The form solicited 
information regarding the usefulness and appropriateness of items (i.e., LRGs and 
TOs) and criteria for successful performance in each domain (e.g., gross motor, 
cognition). In addition, respondents were asked to provide information regarding 
the usefulness of the CEEPS for designing instructional programs and to indicate 
the approximate time necessary to administer the CEEPS. 



The results of this study are presented in three major sections. Reliability 
and validity data are reported in the first and second sections, respectively. In 
the third section the utility of the CEEPS is examined. 

Results are reported for two groups of subjects. One group includes both 
handicapped and nonhandicapped children and the other group includes only 
handicapped children. Because not all parents completed the parent rating form 
were interviewed and not all children were observed (i.e., interobserver and retest 
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data collection observations), the total number of children in both groups varies 
for the different analyses. Pearson moment correlations were computed as a measure 
of test reliability and validity. Criteria used to evaluate the obtained 
correlations are as follows: Very High ( r = .90), High ( r =.70-. 90), Moderate ( r 
= .50-. 70), Low ( r =.30-. 50), and Little, ""if any correlation ( £ = .30) (Hinkle, 
Wiersma, & Jurs, 1979). 

Reliability 

Interobserver Reliability 

CEEPS domain scores were computed by summing the number of items scored pass 
ar.d total test scores were computed by summing the total domain scores. Using CEEPS 
domain and total test scores Pearson product moment correlations were computed to 
determine score consistency or reliability. 

In general the results reported in Table 1 reveal scores are consistent when 
two observers simultaneously observe the same children and rate their performance 
on CEEPS items. Correlations for total test scores suggest a high degree of score 
consistency across CEEPS domains. In addition, observer scores appear to be 
consistent for both nonhandicapped and handicapped children. With the exception of 
the Cognitive domain, moderate to high correlations also suggest observer scores 

are consistent for individual domains. 

i 

Test-Retest Reliability 

Means, standard deviations, and Pearson product moment correlations were 
computed as an index of temporal stability of the CEEPS. Results from the first 
test observation and the retest observation, conducted one to two weeks after the 
first observation, are reported in Table 2. 

The findings suggest a high degree of score consistency or stability over time 
across CEEPS domains for both the total group and the handicapped group. Also, 
individual domain correlations reveal a moderate to high degree of score 
consistency for the Fine Motor, Gross Motor, Social, and Communication domains. In 
comparison, the Cognitive domain (total group) and Self-Care and Cognitive domains 
(handicapped group only) scores are less consistent from one test observation to 
the other. 

Internal Consistency 

Descriptive statistics for domain and total test scores from the CEEPS 
posttests are in Table 3. A coefficient alpha was computed as an estimate of 
internal consistency. This analysis yielded a coeficient alpha of .87 for the CEEPS 
and for each domain coefficients are: Fine Motor ( r =.75), Gross Motor ( r =.66), 
Self-Care ( r =.75), Cognitive ( r =.75), Social ( r =.76), and Communication ( r 
=.76). 

Intercorre lat ions Among Domains 

Pearson product moment correlations w^re computed between each domain and the 
total tfest to obtain Zn estimate of the extent to which CEEPS domains represent 
different constructs or related groups of behaviors. The results are reported in 
Table 4 for the total group (N=29) and Table 5 for the handicapped group (N=l9). 

The results, which are similar for both groups, suggest that some domains 
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TABLE I. Correlation for Domain Total Scores 
Obtained by Two Observers 



Total Group N=28 Handicapped Group N=22 r ; 

Domains r r 



Fine Motor 


.64** 


• 59* 


Gross Motor 


.95** 


• 95** 


Self Care 1 


. 78** 


. 79** 


Cognitive 


.23 


.32 


Social 


.83** 


.82** 


Communication 


.85** 


. 76** 


Total 


.85** 


. 83** 



* j>< .01, two-tailed test 
** £ < .001, two-tailed test 

N=27 for the total group; N=21 for the handicapped group 



TABLE 2. Temporal Stability of Domain and Total Scores 







Total Group N=28 






Handicapped 


Group N= 


22 4 




Domains 


First 
Observation 
M SD 


Re test 
Observation 
M SD 


r 


First 
Observation 
M SD 


Retest 
Observatioti 
M SD 


r 


Fine Motor 


22.36 


4.27 


23.54 


3.60 


.62**** 


21.91 


4.64 


23.05 


3.89 




Gross Motor 


26.89 


6.35 


27.84 


6.55 


, 93**** 


25.68 


6.56 


26. M 


6.69 


. 94**** 


Se'f care 


12.89 


3.25 


13.39 


4.53 


.83**** 


12.27 


3.18 


12.59 


4.46 


.48* 


Cognitive 


17.39 


5.15 


18.57 


5.88 


. 46** 


16.14 


4.61 


17.18 


5.70 


.45* 


Social 


11.68 


3.51 


11.18 


3.91 


. 69*** 


10.95 


3.62 


10.32 


3.97 


.63*** 


Communication 


25.79 


13.47 


29.39 


15.32 


. 76**** 


21.36 


10.92 


25.32 


13.87 


. /0**** 


Total Test 

1 


117.00 


30.38 


123.25 


34.58 


.84**** 


108.32 


28.22 


114.05 


32.49 


. 82**** 



* £<.05» two-tailed test 
** £<.02, two-tailed test 
*** £<.01, two-tailed test 
**** £<.001, two-tailed test 
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TABLE 3. Descriptive Statistics for CEEPS 


Domain 


\ 






and Total Scores 




} 


| * 


Total Group (N=29) 


Handicapped Group (N=19)4 


; Domains 


M 


SD 


M 


SD j 


iIFine Motor 


26.28 


4.87 


25.05 


5.60 § 


' Gross Motor 


30.41 


9.21 


27.58 


10.28 ; 


Self Care 


21.17 


6.12 


19.26 


6.13 g 


Cognitive 


29.83 


8.05 


27.21 


8.77 


Social 


12.83 


3.50 


11.90 


4.01 • 


Communication 


35.93 


16.95 


28.95 


16.03 


Total 


157.48 


43.28 


141.53 


44.37 


• 
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TABLE 4. Intercorrelation Among Domain and Total Scores 
for the Total Group (N=29) 







Fine 


Gross 


Self- 






4 




Domains /Total 


Motor 


Motor 


Care 


Cognitive 


Social 


Communication 


Total 


Fine Motor 


— 


. 63** 


. 74** 


.85** 


.75** 


' .67 v * 


.84** 


Gross Motor 






.64** 


.66** 


.47* 


.71** 


. 73** 


Self-Care 








.89** 


.79** 


.90** 


. 95** 


Cognitive 










.92** 


.88** 


. 96** 


Social 












.78** 


.86** 


Communication 














.95** 


Total 

















* £< .02, two-taiied test 
** £< .001, two-tailed test 
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Table 5. 


Intercorrelation Among Domain iind Total 


Scores 


*i 


i, * 




for the Handicapped Group (N-19) 








V 


Fine Gross 


Self- 






|5prna ins /Total 

R 


Motor Motor 


Care Cognitive Social 


Communication 


Total..;| 


fFine Motor 


— .56* 


# 74*** . 83*** .71*** 


.61** 


.83*** | 


&Gross Motor 




.56* .57* ,36** 


.63** 


.66** • 

\ 


tSeif-Care 




— . 90*** . 79*** 


. 92*** 


9 96*** - 

<< 


^Cognitive 

i 




— .92*** 


. 86*** 


.96*** 1 


Social 






, 7 7*** 


.85*** 


'Communication 








. 94*** 


-Total 










* £< .02, two- 


tailed test 








*** £< .01, tWO- 


tailed test 
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might represent different constructs or contain items which measure distinct groups 
of behaviors. For example, the Gross Motor domain (Table 4) correlated at a low 
level with the Social domain ( r =.47). While this low correlation might suggest 
both domains measures mutually exclusive skills or behaviors, other domains appear 
to contain redundant items or measure related or similar behaviors. For example 
the Cognitive domain and the Social domain did correlate at a high level ( r 
=.92). 

Item Analysis 

Based on performance scores from the CEEPS posttests, an item analysis was 
performed to examine the empirical relationship between item and domain scores and 
item and total test scores. 

Across subjects (N=29) the mean, item-to-domain, and item-to-total correlation 
was computed for performance scores on each item in each domain. Because CEEPS 
items are scored either pass or fail the mean represents the percentage of children 
who passed each item instead of the average score obtained for each item. In 
addition, some items were passed or failed by all children (e.g., "swallows 
liquids", "hops on one foot") which prevented the analysis from yielding means and 
correlations for 33 of the items. Item statistics for the remaining 173 items are 
reported for each domain and can be found on Tables 6,7,8,9,10, and 11 for the Fine 
Motor, Gross Motor, Self-Care, Cognitive, Social, and Communication domains, 
respectively. 

Fine Motor Domain 

Six items in the Reach, Grasp, and Release strand had low item- to-total 
correlations but, high item-to-domain correlations (1.3, 3.1, 4.0, 4.1, 4.2, and 
4.3). One item in the Manipulation of Objects strand had low item-to-total 
correlations but, high item-to-domain correlations (1.1). Two items in the Eye-Hand 
Coordination strand had both low item-to-domain and item-to-total correlations (1.0 
and 2.0); while four items in this strand had low item-to-total correlations but, 
high item-to-domain correlations (3.1, 3.2, 4.0, and 4.2). Correlations for the 
remaining items ranged from moderate to high levels. 

Mean scores suggest some Training Objectives (items) are arranged in a 
hierarchical sequence of difficulty. while others are not arranged in a hierarchical 
sequence. For'example, in the Eye-Hand Coordination strand item 1.2 (fits shapes 
into place, such as a shape board) was passed by a greater proportion of children 
than item 1.1 (fits a variety of shapes into openings, such as a shape box), 
suggesting these items are arranged correctly according to difficulty. However, 
item 4.1 ("Watches hands") was passed by all children while 4.2 ("Brings hands to 
the mouth") was passed by 97 percent of the children. Perhaps item 4.1 is the 
easier of the two items and the order of these two items should be. reversed. 

Mean scores for Long Range Goals in this strand (Eye-Hand Coordination) appear 
to be correctly arranged in the intended sequence of difficulty: The first Long 
Range Goal item measuring the most difficult skill and the last Long Range Goal 
measuring the least difficult skill. 

Gr oss Motor Domain 

The greatest concentration of items in which mean scores and correlations were 
not obtained in this domain are in the first strand: Movement and Locomotion in 
Supine/Prone Position. These items measure early motor skills (e.g., "Lifts head 
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TABLE 6. Fine Motor Domain Item Statistics (N=29) 



Strand 


up 


T9 


Items 


M 


Item-to- 
Domain 
Correlation 


V 

Item-to^ "V 
Total 


Reach, Grasp, 
and Release 


1.0 


l.I 

1.2 


Placet an object on top of another object 

Drops a hand-held object onto or into a 
large target 

Purposefully lets go of an object 


.66 
.90 


• 76 
.66 


■ 

.72 
.56 


$ 
"W 

" 3t£ 
*> 






1.3 


Unclenches fists 


.97 


.60 


.68 






2-0 


2.1 


Transfers an object from one hand to the 
other hand 

Holds object when placed In hand 


.93 


.67 


.66 






3.0 




Grasps a pellet-sized object using a 
plncer grasp 


.96 


.82 


.76 








3.1 


Grasps a hand-sized object 


.97 


.60 


.68 








3.2 


Hakes batting or swiping movements 
directed toward an object 












6.0 




Reaches and obtains an object 


.97 


.60 


.68 








6.1 


Reaches toward an object making contact 
with the object 


.97 


.60 


.68 










Reaches toward an object 


.97 


.60 


.68 








6.3 


Fully extends arms In all directions 


.97 


.60 


.68 




Manipulation of 
Objects 


1.0 


1.1 


Rotates wrist on horizontal plane 

Rotates forearm so It is brought from a 
plane down to palm up position 


.63 
.97 


.73 
.60 


.66 
.66 



ft 



i 
1 



I 



3 
i 



3 
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2.0 




Brings two oblects together 


01 


•87 


• 66 






2.1 


ftotdlt two ohl^<*(4. nnf In t*an/4 


01 


.87 


.66 






2.2 


Brings hands together at midline 








Eye -Hand 
Coordination 


1.0 




Assembles a simple Interlocking pozcle 


.21 


.38 


.69 






I.I 


Fits a variety of shapes Into correct 

Aha n I naa m 

upc n i riK 9 


.66 


.57 


• 66 \ 






1.2 


Fits simple shapes Into correct place 


.83 


.73 


.66 




2.0 




Reproduces shapes after demonstration 


.21 


.38 


.69 . A 






2.1 


Draws circles and shapes 


.39 


.36 


.82 






2.2 


Scribbles 


.93 


.66 


.50 i 




3,0 




Acts on objects across midline of the 
body 


.93 


.87 


.66 






3.1 


Moves arms across midline of the body 


.97 


.80 


.68 






3.2 


Brings two opposing body parts together 
at midline 


.97 


.80 


.68 






6.1 


Brings objects to the mouth 
Watches hands 


.97 


.80 


.68 

i "*"** 






6.2 


Brings hands to the mouth 


.97 


.80 

5 


i 

! 
i 
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TABLE 7. Gross Motor Domain Item Statistics (N=29) 



Strand 


LRG 


TO 


ttCMS 


H 


Item-to- 
Domaln 
Correlation. 


Item- to * 
Total 

Cflff»laHm» 


Movement and 


1*0 




Creeps forward using alternating arm and 


.97 


•SI 


.48 


Locomotion 






leg Movements 




In Supine/ 












Prone 




1 • 1 


Rocks In a creeping position 


.97 


.31 


M * 


Position 












1.2 


Crawl » forward on stomach 


.97 


.31 


.48 






1.3 


Bears weight on hands and reaches with 


.97 


.31 


•48 








arms 










1.4 


Lifts head and chest off surface 










2.0 




Rolls by turning segmental ly from 


.93 


.45 


.64 








stomach to back and from back to stomach 










2.1 


Rolls from back to stomach 












2.2 


Rolls from stomach to back 










3.0 




Moves body parts independent of each 














other 












3.1 


Turns head 90° to the right and left from 














midline position while lying on back 












3.2 


Kicks legs alternately while lying on bad 


.97 


.31 


.48 






3.3 


Waves arms In play while lying on back 








Balance In 
Sitting 


1.0 
2.0 


I.I 


Climbs into and out of child site chair 
Sits In a chalt 

Assumes sitting position on floor 


.90 
.97 
.97 


.51 
.51 
.51 


.70 
.48 
.48 



■m 



w 

m 



<~4 



■1% 







2.1 


Retimes upright fitting position after 
leaning to the left* right* and forward 


.97 


.5! 


<48 






2.2 


Sltf on floor with back erect and hands 
pot touching floor 


.97 


.51 


.48 






C.J 


Holds head erect In supported sitting 


• 93 


.73 


.90 


Bait nee and 

Mobility In 

Standing/ 

Walking 


1*0 


t • 1 
1 . € 


Walks swinging anas reciprocally 
Walks avoiding obstacles 
Walks without support 


.59 
.79 
.90 


.51 
.54 
• 55 


.94 
.59 
.49 






1.3 


Walks forward with one hand supported 


.90 


.55 


.58 




2.0 




Stoops and recovers without support 


.66 


.56 


.48 






2.1 


Assumes a standing position without 
support 


.83 


.55 


.57 






« • * 


Pulls to a standing position using 
support 


.97 


• 51 


• 48 


Advanced 
Cross Motor 
Skills 


l.t> 


1.1 


Climbs up and down ladders 
Climb* up and down stairs 


.52 
.93 


.44 
.57 


.77 
• 55 






1.2 


Climbs on and off a low platform 


.90 


.43 


• 40 




2.0 




Stops on one foot 












2.1 


Jumps forward with both feet together 


.21 


• 41 


.45 






2.2 


Jumps ;;p In one place with two feet 
together 


.48 


.67 


.82 




3.0 




Runs avoiding obstacles 


.59 


.75 


.83 






3.1 


Runs 


.66 


.75 


.74 




4.0 




Pedals and steers a tricycle 


.35 


.54 


.64 






4.1 


Pushes riding toy with feet snd steers 


.66 


.74 


.70 



m 
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J % 



4*2 Sits on riding toy while adult pushes ,90 | .84 

5*0 Catches ball with two hands .31 .50 

5.1 Kicks bait .U 

5.2 Throws ball .86 .80 



.48 
.62 
.82 
.64 



TABLE 8. Self-Care Domain Item Statistics (N=29) 



Strand 


LRG 


TO 


• • 

Itens • 


M 


1 tfm— t o— 
Domain 
Correlation 


Item— to- 
Total 
.Cortt.UtlQQ_ 


Self-Feeding 


1.0 


1.1 


Uses fork and spoon when self-feeding 
Accepts food from a spoon and/or a fork 


.72 


.81 


.7? 




2.0 




Drinks f row a cup/glass without spilling 


.90 


.54 


.53 






2.1 


Drinks from a cup/glass 


.9? 


.38 


.48 






2.2 


Ingests liquid from a cup/glass without 
a nipple 










3.0 




Bites off and chews hard-to-blte finger 
foods from a larger piece of food 


.86 


.SB 


.65 






3.1 


Self-feeds hard-to-chew blte-slsed pieces 
of finger food 


.93 


.51 


.64 






3.2 


Bites off and chews eesy-to-blte finger 
foods from a larger piece of food 












3.3 


Self-feeds easy-to~chew bite-sized pieces 
of finger food 










4.0 


4.1 

4.2 
4.3 

4.4 


Using tongue, moves food/ liquid within 
mouth 

Closes Hps around a cup and eating 
utensils 

Swallows solids 

Swallows liquids 

Ingests liquid by sucking on a nipple 
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Preparing and 
Serving Food 
Using Utensils 
and Containers 


1.0 


1.1 


Tours liquid from one container Into 
another 

Uses a utensil to transfer food from one 
container to another 


.66 
.76 


• 77 

• 77 


.81 

.77 






1.2 


Uses a spoon to stir foods 


.76 


.78 


.78 


Per sonn 1 
Hygiene 


1.0 


I.I 


Complete* toileting routine Independently 

Demonstrates complete bowel /bladder con- 
trol* child Initiated trips to toilet 


.17 
.38 


• 53 
.77 


A4 
.64 






1.2 


Demonstrates complete bowel/bladder con- 
trol* adult scheduled trips to toilet 


.38 


.75 


.70 






1.3 


Indicates awareness of sol let/wet pants 
or diapers to adult 


.72 


.75 


.79 




2.0 




Performs simple self-care activities 


.38 


.77 


.67 






2.1 


Washes and dries face 


.48 


.74 


.58 






2.2 


Washes and dries hands 


.62 


.86 


.81 






2.3 


Obtains tissue and effectively cleans 
nose 


.45 


.84 


.71 






2.6 


Brushes teeth with assistance 


.79 


.64 


.65 






2.5 


Combs/brushes hair with assistance 


.66 


.80 


.70 


Dressing and 
Undressing 


1.0 


t.l 


Independently dresses and undresses self 
Independently dresses self 


.10 


.41 
.42 


.34 
.35 






1.2 


Independently undresses self 


.38 


.66 


.61 



9 
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TABLE 9. Cognitive Domain Item Statistics (N=29) 



Strand 


LUG 


TO 


Items 


H 


It em- to 
Correlation 


Item- to 
oi ai 

.fc>rcftm?n 


Srnsory 
Stimuli 


1.0 


I.I 
1.2 
1.3 


Reftponda to auditory* visual , and tactile 
stimulation 

Responds to auditory stimulation 
Responds to visual stimulation 
Responds to tactile stimulation 


— 
— 


— 
— 


— 


Object 
Permanence 


1 .0 




Locates or successfully searches for an 
object/person not visually apparent 


.90 


.77 


,10 






I.I 


Systematically searches for lost, hidden, 
or displaced object/person 


.90 


.77 


. 70 






1.2 


Searches for completely hidden or dis- 
placed object/person 


.',7 


.57 


.4! 






1.3 


Searches for partially hidden or dis- 
placed object/person 


.9? 


.57 


• 41 




2.0 




Follows object/perron to point of dis- 
appearance 


.93 


.73 


.64 






2.1 


Watches rapidly moving objects/people In 
the environment 


.93 


.73 


• 64 






2.2 


Focuses on objects/people present In the 
environment 








Imitation 


t.O 




Imitates new words and motor actlnns 
approximately 


.59 


.80 


•S3 






1*1 


Imitates unfamiliar vocalisations 
approximately 


.69 


.76 


.79 
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1.2 


Imitates sequence of unfamiliar motor 
actions approximately 


.72 


.76 


• 68 


! 


Causality 


1.0 




Can In some wiv dlr»rtl* »#• t lw a » m » MM / 
w * m j «mj »c i coy/ 

object to produce a desired outcome 


.TO 


• 18 


.70 




• 




1.1 


Attempts to activate toy/object Manually 


.91 


.57 


• 41 








1.2 


Following event by a simple toy/object* 
produces action to Indicate Interest 


—— 


— 


— 






2.0 




following the performance or a familiar 
»(ignf |«^| perioral pare oi action/game 
to Initiate continuation 


•97 


• 57 


.61 


> 






2« 1 


Accempcs oy manipulating aoult body 
part(a) to continue familiar action/fame 


.90 


.77 


• 70 




Problem 
Solving 


1.0 




When confronted with a problem* usea dif- 
ferent strategies to solve it 


.69 


.71 


• 67 








1.1 


Transports more than one object 


.90 


.77 


• 70 








1.2 


Obtains non-reachable objects 


• TJ 


• IJ 


• 64 








1.3 


Mavlgates objects around barrlera 


.9? 


• 73 


• 64 








1.4 


Sequentially stacks and neats unfamiliar 
objects 


.66 


• 73 


• 70 




Object 

Different t at lor 


1*0 




Uses an Inglnary object In play 


' .52 


• 72 


• 79 








1.1 


Uses one object to represent another 


• 66 


• 78 


• 83 






2.0 




Uaes functionally/socially appropriate 
actions with objects 


.90 


• 78 


• 70 








2.1 


Uses objects In combinations 


.90 


• 78 


• 70 








2.2 


Acts on objects using three or more sim- 
ple motor actions 


.90 


• 78 


• 70 








2.3 


Acts on objects by using sensory examina- 
tion 


.93 


• 61 


• 50 



37 



Pre-Acadenlc 
Skills 



t.O 



2.0 



I.I 
1.2 

2.1 
2.2 



Croups or classifies related objects 

Croups similar pictures 

Croups similar objects 

Hatches Similar pictures to • model 

Hatches objects to a picture model 

Hatches objects to an object model 



.5* 


.50 


.48 


.71 


. 66 


•81 


.48 


•68 


.66 


•80 


.12 


.83 



.83 
.82 
.32 
.77 
.81 
.82 
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TABLE 10. Social Domain Item Statistics (N=29) 




Strand 


LftC 


TO 


Items 


M 


Item-to- 
Domain 
■ vorreiariptj 


Item-to- 
Tntal 


Compiles with 

Social 

Conventions 


1.0 


I.I 


Compiles with directions given to the 
child and to a group 

Complies Wkvit directions ttv»n fro fr t»« 

child 


.66 

10 


• WW 

• 87 


• '0 
.79 






1.2 


Complies with directions given to a group 


• 72 


• o« 


• 02 




2.0 




Demonstrates appropriate behavior In a 
variety of different routines 


.86 


• 


*» 






2.1 


Initiates behaviors associated with dally 
routines 


.on 


• '5 


mm 

• J* 






2.2 


Responds enoroorlAtel v to cIum.i t« 
ml routines 


01 

« VJ 


• 5n 


.33 


Interaction 


1.0 




Initiates* responds* and maintains age 
appropriate Interaction with adults 


.90 


•86 


.70 






l.l 


Initiates Interaction with adults 


.93 


•66 


.64 






1.2 


Responds to Interaction Initiated by 
adults 










2.0 




Initiates* responds* and maintains age 
appropriate Interaction with peers 


• 66 


• 68 


• 62 






2.1 


Initiates Interaction with peers 


.79 


• 79 


•69 






1.2 


Responds to Interaction Initiated by 
peers 


.86 


• 88 


.71 




3.0 




Initiates and maintains age appropriate 
Interaction with toys/objects 


.90 


• 7| 


•49 
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TIT 



3.2 



Initiates Interaction with toys/object? 

Showi Interest by vouching other* Inter- 
act with toys/objects 



.97 
.97 



.60 
•60 



TABLE 11. Communication Domain Item Statistics (N=29) 



Strand 


LUG 


TO 


It CMS 


M 


Domal n 
Correlation 


IttM-tO- 

Total 
Correlation 


Social 

Common 1 cat Ive 
Transaction* 


1.0 




Uses aoc In 1 common lent Ive a Ignal a to 
spontaneoualy Interact with adult 


on 

. TV 


.Jo 


• 70 






I.I 


Cains adult attention and then nnlnt* in 
an object or event 


On 

• TV 


. JO 


• 70 






1.2 


Points to object and vocalises 


.93 


.47 


.49 






1.3 


f^iotf A At An Itrl /m*jv*mm A Mai um«I l.aa 

m\ ovjTcif pviion ■no vocal ixes 


•93 


• 47 


.49 






1.4 


Responds with a communicative signal to 
adult'a queatlon 


.97 


• j j 


•ml 




2.0 




Rngages In reciprocal vocal exchangea 
with others 


.86 


.6? 


.71 






2.1 


Engagea In reciprocal motor and vocal 
exchangea with others 


.86 


.62 


.71 






2.2 


Engages In reciprocal motor activities/ 
games with othera 


.97 


.35 


.41 






2.3 


Imltatea reciprocal responses to 
systematic tactile stimulation 


.97 


.35 


.41 




3.0 




Follows adult's marking of mutual topic 


.86 


.61 


.76 






3.1 


Attends to an object while adult comments 
on it 


.86 


.62 


.71 






3.2 


Follows adult'a pointing gestures 


.97 


•35 


.41. 






3.3 


Attends to an object when pointed to or 
manipulated 









41 





4.0 


4.1 
4.2 
4.3 


Attends to speech while speaker Is within 
sensory field 

Attends to an object end speech pre- 
sented within reach of child 

Attends to no tse -producing object within 
child's reach 

Attends to tactile stimulation paired 
with a salient sound 


— 
— 
— 
— 


— 
— 
— 
— 


— 
— 
— 
— 


ji 
> 


Comprehension 
of Words and 
Sentences 


1.0 


I.I 


Follows two-step directions without con- 
textual cues 

Follows two-step directions with contex- 
tual cues 


.48 
.66 


.00 

.80 


.89 
.79 








1.2 


Follows one-step directions without 
contextual cues » 


.72 


.73 


.79 


T 
\ 






1.3 


Follows one-step directions with contex- 
tual cues , 


.06 




.76 






2.0 




Locates named common pictures In an 
unfamiliar context 


.62 


.79 


.77 








2.1 


Locates named common objects* people, and 
events without contextual cuas 


.69 


.79 


.02 








2.2 


Locates named common pictures In a 
familiar context 


.72 


.76 


.82 








2.3 


Locates named common objects* people, and 
events with contextual cues 


.79 


.69 


.00 




Production of 
Signals, Words, 
and Sentences 


1.0 


I.I 


Uses two Inflectional markers In same 
utterance 

Uses the Inflectional marker "s" to 
express possession 


• 21 
.21 


.32 
.56 


.45 
.45 








1.2 


Uses the Inflectional marker "s" to 
express plurality 


.24 


•61 


.51 





I* • 

m 







1.3 


Uses the Inflection*! murker M lng" to 
express the present progressive 


.24 


.60 


.50 




2.0 




Uses three-word utterances (as 30X of 
language sample) 


.35 


.77 


.67 






2.1 


Uses three-word utterances In the form of 
negative imperative 


.41 


.84 


.74 






2.2 


Uses three-word utterances In the form of 
a question 


.38 


.81 


.71 






2.3 


Uses three-word utterances In the form of 
act ton-object -location 


.35 


.77 


.67 






2.4 


Uses three-word utterances In the form of 
agent-act lon-ob jec t 


.41 


.84 


.74 




3.0 




Uses three relational words with object 
labels 


.45 


.87 


.80 






3.1 


Uses two-word utterances to express 
possession 


.52 


.94 


.85 






3.2 


Uses two-word utterances to express 
location 


.41 


.60 


.73 






3.3 


Uses two-word utteranc n to express 
attribution 


.35 


.77 


.67 






3.4 


Uses two-word utterances to express 
recurrence 


.52 


.94 


.8? 






3.5 


Uses two-word utterances to express non- 
existence 


.48 


.92 


.02 






3.6 


Uses one relational 'tord with several 
object labels 


.48 


.92 


.82 




4.0 




Uses at least ten different two-word 
utterances 


.52 


.94 


.85 






4.1 


Uses agent-action, action-object* and 
agent-object utterances 


.52 


.94 


.85 



-In 



it 

»5, 
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IP' 







4.2 


Uses successive slngle~word utterances 


.52 


.94 


.85 






4.9 


Uses aingle-vords plus gestures 


.55 


.91 


•84 




5.0 




Uses a vocabulary of at leaat 60 words 


.52 


• 94 


at 

• 0) 






5.1 


Uses at least live descriptive words 


.98 


.81 


• 72 






5.2 


Uses at least 10 action words 


.52 


.94 


• 85 






5.9 


Uses at least five relational words 


.45 


.89 


.80 






5.4 


Uses at least two pronouns 


.48 


.92 


.82 






5.5 


Uses at least )0 object/event labeta 


.52 


.94 


.85 






5.6 


Uses fit least five person labels 


.52 


.94 


•85 




6.0 




Uses consistent word approximations 


.59 


.88 


.82 






6.1 


Uses consistent consonant-vowel-conso- 
nant combinations 


.69 


.75 


.75 






6.2 


Uses Inconsistent consonant-vowel combl- 
nstlons 


• 89 


.62 


.68 






6.9 


Uses vocalisations 


.90 


.56 


.70 



m 



'48 



44 
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I and chest off surface") and were likely passed by all the children. The lack of 

data prevents examining the extent to which the items are arranged in a 
hierarchical sequence and whether they correlate with domain and total test scores. 

Of the remaining six items in the Movement and Locomotion strand, five items 
had low item-to-total correlations but, acceptable item-to-domain correlations 
(1.0, 1.1, 1.2, 1.3, and 3.2); one item had acceptable item-to-total correlations 
and low item-to-domain correlations (2.0). Four items in the Balance in Sitting 
strand and three items in the Balance and Mobility strand had low item-to-total 
correlations but, acceptable item-to-domain correlations (1.1, 2.0, 2.1 and 1.2, 
2.0, 2.2, respectively). Two items in the Advanced Gross Motor Skills strand had 
both low item-to-domain and item-to-total correlations (1.2 and 2.1). Correlations 
for the remaining items in this domain range from acceptable to very high. 

Generally, mean scores suggest the Long Range Goals and Training Objectives in 
the Gross Motor domain are arranged in a hierarchical sequence. For example, mean 
scores in the Advanced Gross Motor Skills strand reveal that a greater proportion 
of children pass the easier or lower level items than the more difficult or higher 
level items. 

Self -Care Domain 

Similar to the Movement and Locomotion strand in the Gross Motor domain, the 
Self-Feeding strand in this domain contains nine items in which the lack of mean 
scores and correlations prevents an examination of item sequence and the extent to 
which the items correlate with domain and total test scores. 

Of the remaining five items in the Self-Feeding strand only one item (2.1) had 
low correlations (for both the domain and total test). Item-to-domain correlations 
and item-to-total correlations for the majority of items in the Self-Care domain 
ranged from acceptable to high. One item in the Personal Hygiene strand had a low 
item-to-total correlation but, an acceptable item-to-domain correlation (1.0). Two 
items in the Dressing and Undressing strand had both low item-to-domain and 
item-to-total correlations (1.0 and 1.1). 

Items in the Preparing and Serving Foods strand and items under the second 
Long Range Goal (2.0) in the Personal Hygiene strand were not intended to represent 
a logical developmental sequence of skill acquisition. The mean scores for these 
items confirm that these items are not arranged in a hierarchical sequence of 
difficulty. For example, the proportion of children who passed items following the 
Long Range Goal "performs simple self-care activities 11 varies, suggesting these 
skills are not, and perhaps should not be, arranged in a sequenced progression of 
skill difficulty (i.e., one skill obtained before the next skill). 

Cognitive Domain 

All items ir* ...a Sensory Stimuli strand were passed by all the children in the 
sample, which prevents an examination of item sequence and correlations of item 
scores to domain and total test scores. 

Two items in the Object Permanence strand (1.2 and 1.3) and two items in the 
Causality strand (1.1 and 2.0) had low item-to-total correlations but, acceptable 
item-to-domain correlations. Acceptable to high item-to-domain and item-to-total 
correlations were obtained for the remaining items in the Cognitive domain. 

Mean scorer in the Cognitive domain suggest the Long Range Goals and Training 

eric A K 
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Objectives in this domain are arranged in a hierarchical sequence. 
Social Domain 

One item' in the Complies with Social Conventions strand (2.2) and three items 
in the Interaction strand (3.0, 3.1, and 3.2) had low item-to-total correlations 
but, much higher item-to-domain correlations. The remaining items in the Social 
domain had moderate T:o high xtem-to-domain and item-to-total correlations. 

In general mean scores suggest items in the Social domain are arranged in a 
hierarchical sequence of item difficulty. However, the order of the following 
directions items in the first strand (compliance) might need to be changed. A 
greater proportion of children passed Training Objective 1.1 (directions to a 
child) than Training Objective 1.2 (directions to a group) suggesting the order of 
these items might need to be reversed. 

Communication Domain 

The majority of items in the Communication domain had high to very high 
item-to- domain and item-to-total correlations. Six items in the Social 
Communicative Transactions strand had low item-to-domain and item-to-total 
correlations (1.2, 1.3, 1.4, 2.2, 2.3, and 3.2). Two items in the Production of 
Signals, Words, and Sentences strand had low item-to-total correlations but, 
acceptable item-to-domain correlations (1.0 and 1.1). 

Mean scores suggest that Long Range Goals and Training Objectives in the 
Communication domain are arranged in a hierarchical sequence of difficulty. 

Observation and Direct Test Comparison 

Long Range Goal scores obtained by observation and by direct test (i.e., 
directly testing one item at a time) were summarized into total domain scores and 
total test scores. Pearson product moment correlations were computed to examine the 
relationship between performance scores obtained by both methods of assessment 
(i.e., observation and direct test). 

Percent of agreement was calculated for items scored by the data collector who 
administered th3 direct test and a second data collector who simultaneously 
observed the test and scored CEEPS items. Agreement between scores was greater than 
80 percent for each domain and the overall percent of agreement was 89 percent. 

As Table 12 shows the correlation for total test scores ( r =.69) suggests 
that observation might be a fairly accurate (rr liable) method of assessment when 
compared to direct test scores for a selected group of handicapped children (N=8). 
Although the Fine Mctor, Self-Care, and Social domain correlations . reflect little, 
if any, agreement between scores obtained by observation and direct test, the 
remaining domain correlations are more promising. Correlations between scores 
obtained by observation and direct test range from moderate to very high for the 
Cognitive, Gross Motor, and Communication domains. 

Validity 

Concurrent Validity 

The relationship between CEEPS performance scores and three criterion measures 
was examined as a measure of concurrent validity. Pearson product moment 
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correlations were computed to examine the relationship between CEEPS scores and 
standardized test scores and parents judgements of their children's skills and 
abilities. 

Gesell and the CEEPS Comparison 

Performance scores from the Gesell were summarized and converted into 
• Developmental Quotient (DQ) scores and Maturity Age (MA) scores for the Gesell 
overall General Development index and for each scale: Fine Motor, Gross Motor, 
Personal-Social, Adaptive, and Language. 

Results are reported for the total group (N=27) on Tables 13 and 14 and for 
the handicapped group (N=19) on Tables 15 and 16. 

Overall, correlations reveal a strong relationship between performance scores 
obtained on both instruments. The correlation between CEEPS total test scores and 
Gesell DQ and MA scale scores and the General Development index is high. The 
pattern of correlations between the CEEPS Fine Motor domain and the Gesell overall 
(i.e., General Development index) and scale scores are consistently lower than the 
other domains. 

Parent Ratings and the CEEPS Comparison 

Items on the parent rating form which parents checked Yes and Used To were 
tallied and summarized into total domain scores and total overall rating scores. 
Correlations were computed for each domain and the total test to examine the 
relationship between CEEPS and parent rating scores. 

Overall, the results reported on Table 17, suggest a high degree of congruence 
between CEEPS performance scores and parent rating form scores. With the exception 
of the Fine Motor domain, correlations suggest a strong relationship between CEEPS 
domain scores and the parent rating form domain scores. 

Developmenta l Profile II and the CEEPS Comparison 

Item scores (question ratings) obtained during parent interviews were 
summarized and converted into age level scores (age in months) for each domain in 
the Developmental Profile II. Correlations were computed for each domain on both 
instruments to examine the relationship between CEEPS scores and Developmental 
Profile II scores. 

The results are reported in Table 18 for the total group (N=24) and Table 19 
for the handicapped group (N=17). Correlations between domain scores range from 
moderate to high suggesting a strong relationship between CEEPS domain scores and 
scores obtained from parent interviews. 

Utility 

Information from the CEEPS evaluation forms completed by the staff working in 
the EIP (N=4) indicates the CEEPS, for the most part, provides appropriate and 
useful information for designing educational programs for young handicapped 
children. One staff member used the Long Range Goals and Training Objectives 
directly as intervention targets (i.e., IEP goals and program objectives). Although 
one staff member used many CEEPS items as intervention targets, many items were 
felt not suitable for intervention targets (no example of these items were given). 
Two staff members suggested the inclusion of smaller-sequential programming steps 
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TABLE 13. Correlation Between CEEPS Domain and Total Scores and 
Gesell Scale and Overall Developmental Quotient Scores 
Total Group N=27 



Gesell Scales and 
Overall General 
Development Index 


Fine 
Motor 


Gross 
Motor 


Self- 
Care 


Domains 
Cognitive 


Social 


Communication 


Total 


Fine Motor 


.57** 


.68*** 


.74*** 


.73*** 


.68*** 


.75*** 


. 77*** 


Gross Motor 


.60*** 


.79*** 


.73*** 


.74*** 


.65*** 


. 7Q*** 


.77*** 


Personal-Social 


,52** 


.67*** 


.67*** 


.75*** 


.68*** 


. 72*** 


.76*** 


Adaptive 


.56** 


.69*** 


.76*** 


.77*** 


.71*** 


.82*** . 


.81*** 


Language 


.56** 


. 70*** 


.76*** 


.71*** 


.81*** 


.83*** 


.82*** 


General 
Development 


.56** 


# 70*** 


.75*** 


.79*** 


.71*** 


.82*** 


.81*** 



* £< .02, two-tailed test 
** £<.01, two-tailed test 
***£<. 001, two-tailed test 
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TABLE 14. Correlation Between CEEPS Domain and Total Scores and 
Gesell Scale and Overall Maturity Age Scores 
Total Group N=27 



y 

fcV 

r' S ' 


oeseii ocai.es ana 








Doma Ins 










Overall General 


Fine 


Gross 


Self- 












Development Index 


Motor 


Motor 


Care 


Cognitive 


Social 


Communication 


Total 


?'• 


Fine Motor 


.63 


.77 


.83 


..79 


.67 


.88 


.87 


i 


Gross Motor 


.65 


.87 


.82 


.81 


.65 


.84 


.87 


r 
* 


Personal-Social 


.65 


.84 


.92 


.88 


.72 


.93 


.93 


5 


Adaptive 


.64 


.80 


.87 


.85 


.70 


.95 


.92 


i 


Language 


.62 


.79 


.85 


.86 


.70 


.95 


.91 




General 
Development 


.64 


.80 


.86 


.85 


.70 


.95 


.92 




All rs are significant 


at £ 


.001, two- 


■tailed test 
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TABLE 15 ♦ Correlation Between CEEP5 Domain and Total Scores and 
Gesell Scale and Overall Developmental Quotient Scores 
Handicapped Group N=19 



£r » 
- 

h 

!& , 
5 V 


Gesell Scales and 
Overall General 
Development Index 


Fine 
Motor 


Gross. 
Motor 


Self- 
Care 


Doma ins 
Cognitive 


Social 


Communication 


Total 




Fine Motor 


.54* 


.63** 




.67** 


.67** 


.66** 


. 72*** 




Gross Motor 


.68** 


.87*** 


.69** 


.79*** 


.67** 


.66** 


.80*** 


t 


Persona 1-Soc ia 1 


.54* 


.66** 


. 72*** 


.77*** 


. 72*** 


.66** 


.76*** 




Adaptive 


.58** 


.69** 


.82*** 


.81*** 


.77*** 


.84*** 


.435*** 


* 


Language 


.59** 


.75*** 


.85*** 


.90*** 


.82*** 


.86*** 


. 89*** 


t 

I 


General 
Development 


.58** 


. 70*** 


.82*** 


.82*** 


.77*** 


.84*** 


.85*** 



* £< .02, two-tailed test 
** £< .01, two-tailed test 
*** £< .001, two-tailed test 
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TABLE 16. Correlation Between CEEPS Domain and Total Scores and 
Gesell Scale and Overall Maturity Age Scores 
Handicapped Group N=19 



i 


















\x 


Gesell Scales and 








Domains 








i< 


Overall General 


Fine 


Gross 


Self- 










? 
J 


Development Index 


Motor 


Motor 


Care 


Cognitive 


Social 


Communication 


Total 




Fine Motor 


.57** 




, 80*** 


.75*** 


.64** 


.82*** 


•83*** 




Gross Motor 


.62** 


. 89*** 


, 72*** 


. 80*** 


,61** 


. 79*** 


. 85*** 




Personal-Social 


• 60** 


. 82*** 


.91*** 


. 88*** 


. 70*** 


.89*** 


.91*** 




Adaptive 


.58** 


, 77*** 


.83*** 


.83*** 


.68** 


. 94* ** 


. 90*** 


r 


Language 


.56* 


, 79*** 


, 84*** 


. 88*** 


.71*** 


. 94*** 


.91*** 




General 
Development 


.58** 


.78*** 


.83*** 


. 83*** 


.68** 


. 93*** 


. 90*** 



* £<.02, two-tailed test 
** £< .01, two-tailed test 
*** £<.00l, two-tailed test 
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TABLE 17. Correlation Between CEEPS Long Range Goal and Total Scores 
and Parent Ratings of Their Children's Skills and Abilities 



Domain 



Fine 



Gross 



Self- 



** 
k 




N 


Motor 


Motor 


Care 


Cognitive 


Social 


Communication 


Total 




r ■ 

K 

i 


Total Group 


25 


.49* 




. 76*** 


. 79**Vc 


.72*** 


.92*** 


. 90*** 




i 


Handicapped Group 


18 


.24 


. 72*** 


.69** 




• 70** 


.87*** 


.83*** 


4S 



* £< .02, two-tailed test 
** £< .01, two-tailed test 
*** £< .001, two-tailed test 
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TABLE 18. Correlation Between CEEPS Scores and Parent 
Judgements of Their Children's Skills and Abilities 
Total Group N=24 



Domains 



Developmental Fine Gross 

Profile II Domains Motor Motor 



Self- 
Care 



Cognitive 



Social 



Communication 



Physical 


.58*** 


.65*** 


. 68**** 


. 64*** ■ 


. 54*** 


.62*** 


Self-Help 


.48* 


.55*** 


. 68**** 


.60*** 


.52** 


.61*** 


Academic 


.60*** 


.64*** 


. 78**** 


# 75**** 


.66**** 


. 85**** 


Social 




.63*** 


# 77**** 


# 74**** 


.63*** 


.74**** 


Language 


.56*** 


.63*** 


. 78**** 


# 74**** 


.64*** 


. 86**** 



*• £ 05, cwo-tailed test 

.** £ 02, two-tailed test 

*** £ 01, two-tailed test 

**** £ 001, two-tailed test 
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TABLE 19. Correlation Between CEEPS Scores and Parent 
Judgements of Their Children's Skills and Abilities 
Handicapped Group N=17 



Domain 



* £<.10, two-tailed test 
** £<.05, two-tailed test 
*** £< .02, cwo-tailed test 
**** £<.ol, two-tailed test 
***** £< .001, two-tailed test 



Developmental 
Profile II Domains 


Fine 
Motor 


Gross 
Motor 


Self- 
Care 


Cognitive 


Social 


Communication 


Physical 




.68**** 


.61**** 


. 68**** 


. 56*** 


.52** 


Self-Help 


.45* 


.55** 


. 59**** 


.63**** 


.54** 


.47* 


Academic 


.66**** 


.69**** 


• 81***** 


. 89***** 


. 79***** 


. 89***** 


Social 


.66**** 


.71**** 


• 80***** 


.84***** 


. 70**** 


♦ 72**** 


Language 


.58*** 


. 69**** 


. 84***** 


.85***** 


. 74***** 


. 93***** 
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would be helpful when designing programs for many children. 

The staff felt that CEEPS administration time varies according to the child 
being assessed (e.g., degree of impairment, age) and the extent to which the staff 
is familiar with the children. Apparently the first CEEPS administration (e.g.. 
fall pretest) takes longer to administer (two to four hours per child) than 
mid-year or end of the year administrations, which range from 30 minutes to one 
hour per child. 

DISCUSSION 

Professionals working with young handicapped children are frequently 
confronted with a dilemma. The need to provide appropriate and effective 
educational programs and demonstrate the efficacy of intervention efforts is, in 
part, dependent on adequate assessment instruments and strategies. However, few 
assessment instruments exist which are suitable for populations of handicapped 
children under three years of age. The majority of available assessment instruments 
inadequately assess skills and abilities of young handicapped children and provide 
limited information for educational and evaluation purposes. 

The findings from this study suggest that the Comprehensive Evaluation and 
Programming System (CEEPS) is perhaps a viable assessment alternative for those 
working with handicapped preschool children. This study examined selected 
psychometric properties of the CEEPS and explored the instrument's usefulness for 
designing educational programs. Findings suggest that not only can the CEEPS be 
administered in a reasonable amount of time and provides information which assists 
interventionists in the formulation of intervention goals and instructional 
programs, but the CEEPS might be considered a reliable and valid assessment 
instrument. 

Reliability 

Although "direct test" and "report" are allowed methods of assessment for the 
CEEPS, the preferred method of data collection is observation. The underlying 
premise of the CEEPS is that observing children in routine settings while they 
participate in daily activities increases the likelihood of observing (i.e., 
assessing) naturally occurring (i.e., spontaneous) and functional behaviors. 

.This study, which examined the extent to which the CEEPS is a reliable 
observation instrument, revealed that scores obtained through observation are 
fairly accurate and consistent over time. 

Score Consistency 

Correlations for total test scores suggest a high degree of agreement between 
observer scores when two observers simultaneously observe the same children and 
score CEEPS items. Similarly, when children were observed twice with a brief time 
period between observations CEEPS total test scores were consistent or stab 1 - from 
one test observation to the other. However, agreement between observer scores for 
items in individual domains varied as indexed by low, moderate, and high 
correlations. Observer scores differed significantly for items in the Cognitive 
domain and test-retest correlations were substantially lower tor Cognitive domain 
scores than the majority of other domain scores. 
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A review of the data recording forms for both interobserver and test-retest 
data revealed a greater proportion of items scored differently for items in the 
Object Permanence, Imitation, Causality, and Problem Solving strands than in other 
strands. For example, the Long Range Goal "Imitates new words and motor actions 
approximately" and Training Objectives "Imitates unfamiliar vocalisations 
• approximately" and "Imitates a sequence of unfamiliar motor actions approximately" 
(Imitation strand) were frequently scored differently by the observers. The lack 
of agreement between- observer scores for these items, and perhaps other items in 
the Cognitive domain might be due to several factors. First, the lack of score 
agreement might be a function of observer error (e.g., recording a pass score when 
the observer intended to record a fail score). Second, perhaps the items are poorly 
written (e.g., confusing wording) and/or the behaviors to be assessed are poorly 
defined in the criteria (e.g., unfamiliar actions, approximate imitations). 
Finally, perhaps many cognitive skills such as imitation behaviors, are difficult 
to assess by observation and perhaps require some degree of inference when scoring 
items using dichotomous scores (i.e., pass or fail scores). 

Although, there was some disagreement between observer scores for both 
interobserver and test-retest scores, overall the results provide some evidence 
that CEEPS items accurately measure children's skills and abilities and scores are 
consistent or stable over time. Overall, the CEEPS was found to be a generally 
reliable observation instrument vith the present population. 

The comparison between CEEPS scores obtained by observation and scores 
obtained by directly testing one item at a time lends some support to the 
credibility of the CEEPS as an observation instrument. Unfortunately the 
observation and direct test comparison is limited because of the small number of 
children in the sample (which might partially account for the low correlations 
obtained for several domain scores). However, correlations for total test scores 
reveal substantial agreement between observation and direct test scores for many 
of the items in the CELPS. 

CEEPS Domains and Items 

Intercorrelations Among Domains 

Correlations were computed between each domain and the total test to examine 
the extent to which domains represent distinct constructs or contain items which 
measure specific groups of behaviors. The results suggest that some domains appear 
to represent different constructs while other domains appear to contain redundant 
items or measure related or similar skills. For example, the Gross Motor domain 
correlated at a low level with the Social domain while the Cognitive domain 
correlated at a high level with the Fine Motor domain. These results are not 
surprising considering the nature or skills and behaviors that items in these 
domains assess and the difficulty in categorizing early developmental behaviors in 
mutually exclusive categories U.e., domains). Items in the Social'domain measure 
compliance and interaction skills and items in the Gross Motor domain measure 
mobility, balance, and advanced gross motor skills. Items in these two domains 
appear to measure unrelated skills and a low correlation between these domains 
might be expected. However, the Cognitive domain may measure skills that are 
dependent on other skills in other domains. For example, an infant who demonstrates 
object permanance by removing a cover which hides a toy also demonstrates reaching 
and grasping skills (typically considered fine motor skills). A high correlation 
might be expected between domains which measure related skills such as the 
Cognitive and Fine Motor domains. 
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Although some domains might contain redundant items, a careful examination of 
individual items may be necessary before items are eliminated from domains because 
of high intercorrelations. 

Item Analysis ' 

Usually an item analysis is conducted to help determine which items should be 
included in a test and which items should not be included in a test. The item 
analysis conducted in this study did provide some useful information about the 
items contained in the CEEPS. The mean scores (percentage of children who passed 
each item) provided information about item arrangement and the item-to-domain and 
item-to-total correlations provided information about which items correlate with 
the construct(s) the test is measuring. 

However, an interpretation of the item analysis conducted in this study should 
be qualified by two possible limitations. Generally the inclusion of items in a 
test is determined by those items which: 1) have a large standard deviation and 2) : 
correlate highly with the total test score (a relability index) (Becker & 
Engelmann, 1976). 

Scores on the CEEPS represent dichotomous variables: pass scores and fail 
scores. As previously mentioned mean scores which were calculated for each item 
represent the percentage of children who passed the item rather than the mean or 
average item performance score. In addition, dichotomous scores prevent the 
calculation of meaningful standard deviations (i.e., range of item difficulty). For 
dichotomous scores (i.e., pass-fail scores) the standard deviations correlate with 
the mean score and do not provide information about the range of item difficulty. 
For example, a mean score of .50 (score passed by 50 percent of the children) 
results in a standard deviation of approximately .50; a mean score of .97 (score 
passed by 97 percent of the children) results in a standard deviation of 
approximately .19. In other words, the greater percentage of children who pass (or 
fail) an item the smaller the standard deviation; as the percentage of children who 
pass (or fail) an item decreases the larger the standard deviation. Without a mean 
score which represents the average performance on items (i.e., mean level of 
difficulty) and standard deviations which indicate the range of difficulty on both 
sides of the mean it might be inappropriate to make decisions about the inclusion 
or exclusion of items contained in the CEEPS. 

Also, items are usualy preferred for inclusion in a test which correlate 
highly with the total test score (i.e., correlate with what the test is measuring). 
Typically, item analyses are conducted on standardized tests which often measure a 
general construct (e.g., intelligence). The CEEPS, a criterion-referenced test, may 
not measure one general construct but several as represented by different domains 
of behavior (e.g., motor, cognition, social). Examining items which have high 
item-to-domain correlations might suggest which items correlate with the construct 
individual domains are measuring rather than examining whether items correlate with 
the overall test (item-to-total correlations). 

An additional analysis might be equally as helpful. Each domain is divided 
into a series of strands which represent specific related groups of behaviors. 
Items within strands are thought to measure specific skills and behaviors relevant 
to the individual strands. Perhaps item-to-strand correlations would provide 
additional information to determine the extent to which items within strands are 
measuring specific groups of behaviors thought to be measured in each strand. 
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Another possible limitation of the item analysis conducted in this study is 
the relatively small number of children and the limited age range of children who 
participated in this study* A number of items were passed by all the children and 
consequently were eliminated from the analysis (i.e*, mean scores and correlations 
could not be computed). In order to obtain information about the items that were 
eliminated from the analysis (e.g., "swallows solids" "lifts head and chest off 
surface") performance scores are needed for younger children (i.e., less than 20 
months of age). 

Regardless of certain limitations, the item analysis did provide some 
important information. The mean scores (percentage of children who passed the 
items) suggest which items: 1) might be arranged in a hierarchical sequence; 2) are 
not and perhaps should not be arranged in a hierarchical sequence; and 3) should be 
rearranged into a hierarchical sequence. Knowledge of the item sequence will 
facilitate test administration. For example, interventionists will need to assess 
all items within strands which are not intended to be arranged in a sequence and 
will only assess certain items within strands which are arranged in a logical 
developmental sequence. 

Validity 

The relationship between scores on the CEEPS and the Gesell, a parent rating 
form, and the Developmental Profile II was examined as a measure of concurrent 
validity. 

Overall, the results suggest a strong relationship between CEEPS scores and 
scores on the three criterion measures. The results might imply the CEEPS measures 
skills and behaviors which it purports to measure and might be used to estimate 
children 1 s present (or current) skill levels across major domains of development. 

Although generally there was substantial congruence beween CEEPS scores and 
parents perception of their children's skills and abilities, there was a weak 
relationship between CEEPS Fine Motor domain scores and the parent rating form* The 
lack of congruence between CEEPS scores and parents' s ratings of their children's 
fine motor skills might be a function of the criterion measure (i.e., rating form) 
or parent's inability to correctly assess fine motor skills and behaviors. Also the 
lack of congruence between scores in the Fine Motor domain might be due to error 
when the interventionists administered the CEEPS during Spring posttests. 

Utility 

The usefulness of the CEEPS depends on its practical attributes as well as its 
psychometric integrity. This study suggests the CEEPS can be successfully 
administered by interventionists in educational settings in a reasonable amount of 
time* In addition, based on information from a limited number of interventionists' 
the CEEPS appears to provide appropriate information which can be translated into 
intervention programs for young handicapped children. 

Significance of Study 

There are many assessment instruments available, however most available 
instruments are inappropriate for use with handicapped children under three. The 
CEEPS offers a potentially useful assessment alternative that enables comprehensive 
assessment of skills and abilities and provides information for educational 
programming and evaluation purposes. 

Er|c 66 



References 



Alpern, G. , & Shearer, M. The developmental profile II (Rev, ed. ). 
Aspen, CO: Psychological Development Publications, 1980. 

Anastasi, A. Psychological testing * New York: MacMillan Publishing 
Co., 1976. 6 

Anastasiow, N. A philosophical perspective: Why measure child progress? 
In T. Black (Ed.), Perspectives on measurement, a collection of 
readings for educators of young handicapped children . Chapel Hill, 
NC: Technical Assistance Development System (TADS), 1979. 

Bagnato, S. Developmental scales and developmental curricula: Forging 
a linkage for early intervention* Topics in Early Childhood 
Special Education , 1981, 1.(2), 1-8. 

Bagnato, S., & Neisworth, J. Linking developmental assessment and 
curricula . Rockville, MD: Aspen Publication, 1981. 

Becker, W. , & Englemann, S. Teaching III: Evaluation of instruction . 
Chicago, IL: Science Research Associates, Inc., 1976. 

Borg, W., & Gall, M. Educational research . New York: Longman, 1979. 

Bricker, D. , & Littman, D. Intervention and evaluation: The inseparable 
mix. Topics in Early Childhood Sp ecial Education, 1982, 1(4), 
23-33. 

Bricker, D. , Seibert, J., & Scott, K. Early intervention: History, 
current status and the problems of evaluation. In D. Doleys, T. 
Vaughn, & M. Cantrell (Eds.), Interdisciplinary assessment and 
treatment of developmental proble ms. New York: Spectrum, Inc., 
1978. 



Bricker, D., & Sheehan, R. Effectiveness of an early intervention pro- 
gram as indexed by child change. Journal of the Division for 
Early Childhood , 1981, 4, 11-27. ' " 

Bricker, D. , Sheehan, R., & Littman, D. Early intervention: A plan 
for evaluating program impact. Seattle, WA: Western States 
Technical Assistance Resource (WESTAR), 1981. 

CAPE. Consortium on Adaptive Performance Evaluation. Adaptive assess- 
ment for evaluating the progress of severely/profoundly handicapped 
children functioning between birth to two years . Final report of 
a field initiated research project funded by the Bureau of Educa- 
tion for the Handicapped, Grant No. G00702139, 1981. 

Cohen, S., Semmes, M. , & Guralnick, M. Public Law 94-142 and the 
education of preschool handicapped children. Exceptional 
Children , 45, 1979, 279-285. 

Cr.oss, L., & Johnston, S. A bibliography of instruments. In L. Cross 
& K. Goin (Eds.), Identifying handicapped children: A guide to 
case-finding, screening, diagnosis, assessment, and evaluation . 
New York: Walker Publishing Co., 1977. 



67 



54 



Darby, B. Infant cognition: Considerations for assessment tools. i n 
Dart) y & M * Ma y (Eds.), Infant assessment; Issues and applica - 
tions. Proceedings of conferences sponsored by the Western Stales 
Technical Assistance Resource (WESTAR), Seattle, WA, 1979. 

DuBose, R. Adaptations in measurement procedures: Should you make 
alterations- fcr handicapped children? In T. Black (Ed.), 
Perspectives on measurement, a collection of readings for educa- 
tors, of young handicapped children. Ch»p»i mn, M ". feThnlcIl 
Assistance Development System (TADS), 1979. 

DuBose, R. Assessment of' severely impaired young children: Problems 

fSo/ 6 ?^ 0 ?" 008 - Topics in Ea rlv Childhood Special Education . 
1*81, JK2), 9-18. " - 



DuBose R., Langley, M. , & Stagg, V. Assessing severely handicapped 
children. Focus on Exceptional Children . 1977, 9(7), 1-13. 

EvanS ' E- Program evaluation in early childhood/special educatio n; 

A self-help guide for practitioners . Monmouth, np. westert ates 
Technical Assistance Resource (WESTAR), 1982. 

Filler, J. Sensorimotor assessment performance as a function of task 
materials. In D. Bricker & W. Bricker (Eds.), Toddler an d pre- 
school research and int ervention pro -j eer. . Report-year III. 
George Peabody College, Nashville, TN, 1973. 

Fischer, K. A theory of cognitive development: The control and con- 
87(6)r477-53l ierarChieS ° f SkiUS ' Psycholo 8 ical Review > 1980, 



FiSC ^ r, R K 'sVL CO r r p r H 8an, R ' A Sk K U appr ° aCh t0 la "8 ua 8 e development, 
in R. Stark (Ed.), Language beh avior in infancy an d early c hild- 
hood. New York: El.~,evier/Northholland, 1981. 

Garwood G. Early childhood intervention: Is it time to change outcome 
Variables? Topics in Early Childhood SoeciaT Education ?o«? ? 

1X-X1. ' 



Hamilton, J., & Swan, W. Measurement references in the assessment of 
preschool handicapped children. Topics in Early Childh ood Special 
Education , 1981, 1(2), 42-48. 1 special 

Hinkl scie; ce r er rh a ' W " t' 11 "' S ' Applied statisti » the behayioraj 
1979? Chlca ?°> IL; R a "d McNally College Publishing Co., 

Hymes, D. School budgeting: Problems and solution.. Sacramento, CA: 
Educational News Service, 1982. 

Johnson, N. Assessment paradigms and atypical infants: An interven- 
. tiomst s perspective. In D. Bricker (Ed.), Application o f 
research findings to intervention w ith at-risk and handicapp ed 
infants. Baltimore, MD: University Park Press, 1982 ^~ 



ERIC 68 



55 i 

Johnson, K. , & Kopp, C. A bibliography of screening and assessment \* 
measures for infants, Project REACH, UCLA Graduate School of * 
Education, Los Angeles, CA, undated. 

Kopp, C. Mildly to moderately handicapped infants: What should 
influence your approach to measurement? In T. Black (Ed,), 
Perspectives on measurement: A* collection of readings for 
educators^ of young handicapped children. Chapel Hill, NC: 
Technical Assistance Development System (TADS), 1979. 

MacTurk, R. , & Neisworth, J. Norm referenced and criterion based 
measures with preschoolers. Exceptional Children , 1978, 45, 
34-39. ' — 

Oregon State Mental Health Division. The student progress record . 
Salem, OR, 1977. 

Ramey, C, Campbell, F. , & Wasik, B. Use of standardized tests to 
evaluate early childhood special education programs. Topics in 



„ -.7 iuiiwwu a^idi cuuttttiyn programs. 

Early Childhood Special Education , 1982, ±(4), 51-60. 



Sax > G * Principles of educational and psychological measurement and 
evaluation . Belmont, CA: Wadsworth Publishing Company, 1980. 

Sheehan, R. Measuring child progress: Large group design and norm- 
referenced alternatives. In M. May (Ed.), Evaluating Handicapped 
Children's Early Education Programs . Proceedings of the 1979 
WESTAR evaluation workshop, January 3l-February 2, 1979. 
Albuquerque, NM: Western States Technical Assistance Resource 
(WESTAR), 1980. 

Sheehan, R. Infant assessment: A review and identification of emergent 
trends. In D. Bricker (Ed.), Application of research findings to 
intervent ion with at-risk and handicapped infants . Baltimore, MD: 
University Park Press, 1982. 

Sheehan, R. , & Keogh, B. Strategies for documenting progress of handi- 
capped children in early education programs. Educational Evaluati on 
and Policy j:,dlysis , 1981, 3(6), 59-67. 

Shp'.nan, R. , & Keogh, B. Design and analysis in the evaluation of 
early childhood special education programs. Topics in Early 
Childhood Special Education , 1982, 1(4), 81-88. 

Simeonsson, R., Huntington, G. , & Short, R. Individual differences and 
goals: An approach to the evaluation of child progress. Topics in 
Early Childhood Special Education , 1982, 1(4), 71-80. 

Simeonsson, R., & Wiegerink, R. Accountability: A dilemma in infant 
intervention. Exceptional Children , 1975, 41, 474-481. 

Swan, W. The handicapped children's early education program. Exceptional 
Children , 1980, 47, 12-16. K 




IF 



56 

Switzky, H., Rotatori, A., Miller, T., & Freagon, S. The developmental 
model and its implications for assessment and instruction for the 
severely/profoundly handicapped. Mental Retardation , 1979, 17(4), 
167-170. — 

Takanishi, R. , & Fleshbach, N. Early childhood special education pro- 
grams, evaluation, and social policy. Topics in Early Childhood 
Special Education , 1981, H4), 1-9. 

Uzgiriz, I., & Hunt, J. McV. Assessment in infancy: Ordinal scales of 
psychological development . Urbana, IL: University of Illinois 
Press, 1975. 

Walls, R. , Werner, T. , Bacon, A., & Zane, T. Behavior checklists. In 
J. Cone & R. Hawkins (Eds.), Behavioral assessment; New directions 
in clinical psychology . New York: Brunner/Mazel , 1977. 

White, 0., Edgar, E., Haring, N., Affleck, J., Hayden, A., & Bendersky,* 
M. UPAS: Uniform performance assessment system * Columbus, OH: 
Charles E. Merrill, 1980. 

White, 0., & Haring, N. Evaluating educational programs serving the 
severely and profoundly handicapped. In N. Haring & D. Bricker 
(Eds.), Teaching the severely handicapped, Volume III . Columbus, 
OH: Special Press, 1978. 

Yarrow, L. Historical perspectives and future directions in infant 

development. In J. Osofsky (Ed.), Handbook of infant development . 
New York: John Wiley & Sons, 1979. 



ERIC 



70 



APPENDIX A 

SELECTED PAGES FROM THE CEEFS ADMINISTRATION MANUAL 
AND DATA RECORDING FORMS 
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CEEPS: Number of Strands and Item 



DOMAIN 



Fine Motor 



Gross Motor 



Self- Care 



Cognitive 



STRANDS 



NUMBER OF 
STRANDS 



NUMBER OF 

TERMINAL 

GOALS 



mm* or 

TRAIN1IC 
OBJECTIVES 



Social 



Communication 



A Reach, Grasp, and Release 
B Manipulation of Objects 
C Eye-Hand Coordination 

Total 

A Movement and location in 

Supine/Prone Position 
B Balance .in Sitting 
C Balance and Mobility in 

Standing/Walking 
D Advanced Gross Motor Skills 

Total 

A Self-Freding 

B Preparing and Serving Food 

Using Utensils and Containers 
C Personal Hygiene 
D Dressing and Undressing 

Total 

A Sensory Stimuli 

B Object Permanence 

C Imitation 

D Causality 

E Problem Solving 

F Object Differentiation 

G Pre-Academic Skills 



A Complies with Social 

Conventl ons 
B Interaction 



TotO 



Total 



A Communicative Transactions 
B Comprehends single 

Words and Sentences 
C Production of Signals, 

Words and Sentences 

Total 

GRAND 
TOTAL 



23 



NUMBER 
ITEMS 



4 


» 


13 


2 


3 


5 


4 


8 


12 


Tu~ 




"35- 


3 


9 


12 


2 


4 


6 


2 


5 


7 




9 


14 






T 


4 


10 


14 


l 


2 


3 


2 


8 


10 


1 


2 


3 






TT 


1 


3 


4 


I 


5 


7 


1 


2 


3 


2 


3 


5 


* 


t 


c 


2 


4. 


6 


2 


1 


6 


nrr* 


25 


36 


2 


4 


6 


3 


6 


9 


5 


TC 


TT" 


4 


13 


17 


2 


6 


8 


6 


25 


31 


1Z 






$8 


148 


20$ 
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Domain: Fine Motor 



Strand: Eye.-«and Coordination 

LRG1.0 TKe child assembles a simple interlocking puzzle* 
CRITERIA 

The child fits puzzle pieces together in at least two different 
interlocking puzzles. The puzzles should have at least three 
pieces that interlock. 



DIRECTIONS 

Materials: Simple 3 or 4 piece interlocking puzzles. 
Position: Sitting or functional position for the child. 

Procedure: Observation 

Observe the child playing with a puzzle. Notice whether 
the child correctly fits the puzzle pieces together. 
Observe the child playing with t*?o different puzzles. 

Direct Test 

Present the child with puzzle and puzzle pieces. 
Encourage the child to fit the puzzle together and record 
whether the child correctly fits the puzzle pieces 
together. Test three times with at least two different 
puzzles • 
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T01.1 The child fits a variety of different shapes into 
correct openings* 

CRITERIA 

On two occasions, the child fits at least three different 
shapes (e.g., cross, triangle, circle) into the correct corre- 
sponding openings* 

DIRECTIONS 



Materials: 



Position: 



Any piece of equipment that has a variety of shapes and 
corresponding openings (e.g., shape box, shape board). 

Any position that allows the child to manipulate the 
materials. 



Procedure: Observation 



Observe the child playing with the materials. Notice 
whether the child correctly fits at least three dif- 
ferent shapes into the correct openings. Observe the 
child on two different occasions. 

Direct Test 

Present the child with the materials. Encourage the 
child to fit three different shapes into openings. 
(The adult might have to hand the child three dif- 
ferent shapes.) Test three times. 
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T01.2 The child fits simple shapes in correct place. 
CRITERIA . 

On two occasions the child fits three different simple shapes 
(e.g., circle, square, triangle) in correct place in a form- 
board or simple shape puzzle. 

DIRECTIONS 

Materials; Formboards or simple puzzles (that do not interlock) 
with at least three different pieces. Formboardor 
puzzle pieces that have attached handles or knobs may 
be used. 

Position: Any position that allows the child to manipulate the 
materials. 

Procedure: Observation 

Observe the child playing with the materials. Notice 
whether the child correctly fits at least three dif- 
ferent shapes in correct place. Observe the child on 
two different occasions. 

Direct Test 

Present the child with the materials. Encourage the 
child to fit three different shapes in correct place. 
(The adult might have to hand the child three dif- 
ferent shapes.) Test three times. 
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PAGE 1 »T S 



COMMUNICATION 
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APPENDIX B 
GESELL PROTOCAL FORMS 
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PSYCHO-EDUCATJON ASSESSMENT: 



Pre or Post 



IDf: 

TESTING DATE: 

BIRTHDATE: 

AGE: 

SCHOOL: CSB - Intervention Project 

REFERRED BY: CCD. 

EXAMKER: 

TEST ADMINISTERED: Revised Gesell Test 



TEST RESULTS SUffttRV: 



CKROnOLOSICAL AGS DEVELOPMENTAL HATUR1TY AGE 

QUOTIENTS ISEC/fO^KS 



General Development 
Adaptive Behavior 
Gross ibtor 
Fine tiotor 
Language 
Personal -Social 
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g o x o 4 Uocfcs or ic s 08x0 8 Hecks 



040 

041 

04? 
043 

044 

045 
046 

04? 
04n 
049 
OSO 

051 
052 
053 
054 








AUAPllVC 

Dangling King, Rattle: regards, line of 
vision only (*0w) 

Dangling King, Rattle: follows to midline, 
not beyond (*M*) 

Rattle: retains briefly (*l6w) 

Bird Call » Bell-Ring: attends, reduces 
activity <«24w) 

Bird Call, Bellying: facial response <*24w) 


Oft: 

06? 








AbAHM " 

O.Rlng, Ra: dcUycTmTdVlne regard (MI*) 
O.RIng: follows past midline (M6w) 
O.Rlng: follows vertically 








CROSS MOTOR 

Supine: side position head predominates (*12W) 
Supine: tonlc-ncck*rcflcx position 

predominates (*IN) 
Pull-to-SU: complete head lag <*20*) 
Sit: head sags <*0m) 
Sit: hack rounded <«1fiw) 
Ventral Suspension: no head or leo 

condensation (*0w) 
Prone Placement: head rotates <*IN) 
I'ronc: barely lifts head (*Dw) 
Pro«ie: hips hloh ( *IW) 
Prone: crawling movements (*0w) 


066 
067 

m 

060 

070 
071 








CROSS MOTOR 

ji^rinv. rmmv Hifl'pojmon seen \ ' cw / 1 

Supine: symmetric postures seen (.MN) 
SH: head hohblngly C rect (MN) 
Ventral Suspension: head compensates, 

not legs flfa) 
Prone: head to 45° recurrently 
Prone: hips low, frog position (*16w) 


055 
056 








Fine ftotnn 

Dangling Ring, Rattle: hand clenches on 

ConUct (*16w) 
lupine: hands fisted (M2w) 


07? 








F WE MOTOR 

O.Rlng: retains 


057 
050 
059 








LANGUAGE 
expression: Impassive face (*Pw) 
expression: Indirect regard (*0w) 
Vocalization: small, throaty noises (*fiw) 


073 
074 
075 
076 
077 






lAHMIAftr 
Exptcsslon: alert "face 
Expression: direct regard 
Vocalisation: "talks hack" 
Vocalization: single vowel sounds (*28w) 
Vocalization: coos < 4 20w) 


[)C0 
061 

1SZ 








rfRSOHAl-SOClAt 
Supine: stares Indefinitely (*Bw) 
Social: regards examiner, .reduces 

activity (*ftw) . 
feeding: Z night feedings (•"*) 


07n 

079 

ono 

001 








PrRSOriAL-SOCIAl 
Supine: regards examiner recurrently (*!**) 
Social: follows moving person 
Social: smiles responslvely 
feeding: 1 night feeding (•---) 



II ■ History; 0 • Ol>servatlon; (•) • pattern replaced by more mature one at later age 
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S S x © 12 tfccki ^ 6 x o H Weeks 



002 

on) 
om 

DBS 

WOO 

01)7 

onn 

09O 
091 






1 


O.RIng.Ra: prompt midline regard (*lfiw) 
n.Rln^.R*: glancrs at In hand (Mow) 
O.Rinti: circular coordination 
Ra: follows past Midline (*16w) 

B* • f nl |mk wr i*f 1^* 1 1 w 
Kl, lOIIOrfl fCniCIII/ 

Table top: regards table nr hands 
H.Ctibcs.Oip: regards imaedlatcly 
M.CubcS.Ctip: regard* pmlongedly 
M.Cubrs.Coi*: Aimt activate (•20w) 
Yam: follows across table 


109 
MR 
111 
112 

114 
115 
116 
117 
lift 
119 
120 

171 
122 
12) 
124 

125 

It" 

127 
12R 




— 




ADAPftVC 

Dangling Ring, Rattle: rco*rds immediately 

Dangling Ring, Rattle: arms activate (*20w) 

Dangling Ring, Rattle: achieves 1M* arc 

Dangling Ring, Rattle: regards in hand 

lUttnllhH RIm*. Rjittte* In width 

D.RIng,Ratt1e: free hand ringers* holds 

Cube* feell: regards Immediately 

Cube, Rctl: ar«s activate (*20w) 

Cube* Retl: contacts <*20») 

2nd 0«be: holdt 1 placed* regards 2nd (*2ow) 

Yarn; follows 1W In air 

Pellet:, delayed recurrent regard (*24w) 


092 
093 
094 
09S 
096 
097 
0911 
099 

100 
101 
102 
10) 








moss mm 

Supine: bead mid-position predominates 
Supine: symmetric postures predominate 
Sit: head set forward, hobs (M6w) 
Stand: small rractloo weight briefly (*20w) 
Prone Place: bead midline sustained 
Prooe: head at 45 B sostalnedly 
Prone: bead to platfnrm with control 
Prone: on forearms spontaneously 






CROSS HOlflR 
Supine: hands engage 
Sit: bead set forward* steady (*20w) 
Sit: lumbar curvature only (*24w) 
Ventral Suspension: head* legs compensate 
Prone: head to 90° sostalnedly 
i rone* icg> cxicfiucv 
Prone: 1 arm flexed, 1 extended (*20w) 
Prone: mils to supine 






rine huiok 

Supine: hiin^t open or loosely dosed 
Supine: f^ers, scratches (*24w) 
O.Ring.Ra: holds actively* placed (*16w) 
fl.Cubcs.Cup: contacts (*2(X<) 


129 
130 
1)1 








FMIC IIOTOR 

Dangling Ring, Rattle: band curls actively 
Rattle: retains 

Tablctop: fingers* scratches tabletop 


104 








tAICUACC 
Vocalitatlon: chuckles 


1)2 
133 
134 
135 






LAW4MGC 

expressive: breathes heavily* excites (*24w) 
Vocalitatlon: Uughs out loud 
Vocalitatlon: squeals 
Vocalitatlon: "talks* to toys or people 


tos 

106 

107 
108 








PrKSniAUSOCML 
feeding: anticipaTcTtooo' on "sight 
Supine j regards examiner ■ 

predominantly (••••) 
Playt band regard (*— ) 
Play: hand play, mutual fingering (*24w) 


136 
i37 

I3n 

139 
HO 
141 








PCRSOHAI.-SOCIAI. 
reeding: pa ts"ooinFrBolh"IJanrfs (Mow) 
Social! smiles, vocal lies, ptiU-lo-sit 
(*24w) 

Social: spontaneous* social smile 
Play: sits propped 10-1S minutes 
Play: pulls clftthcs over face (*24w) 
Hirrof: tallies I vocalitcs 
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8 S 



B 8 ae o gOWccfcs gl 8 x o ?< jtegks 



H? 

H3 

144 

HS 
HS 

H7 
MR 
H9 
15<* 








mpxm 

t).RIng»R«: 2-hand approve* (•?!!) 
O.RIng.Ra: grasps by completing 

Ra: looks after lost rattle 
Cube: ?-hand approach (*?**) 
3rd Cube: holds ? placed* regards 

3rd (*?0w) 
M. Cubes r 9rasp$ 1 on contact ( # ?4w) 
H.Cithcs: exploits 2 cubes 
Sell: ?-hand approach I grasp (*?flw) 
Yarn: turns head after fallen yarn 


16? 
163 

ICS 
166 
167 

ion 

169 

170 

171 


i 






ADAPTIVE 

Ra: ?«hand approitfTVjras? (*?**) 

Ra: shakes actively 

Ra: reaches after dropped rattle 

Cube: ?*hand approach t grasp (*?8w) 

Cube. Hell: to couth 

Cubes: rose cures dropped cube 

M.Cuhes: grasps 1st, grasps 2nd 

H. Cubes; exploits 3 cubes 

Cup t It. Cubes : retains cube* regards cup 

Tarn: looks for fallen yarn 


1S1 
IS? 

1S1 
1SS 
156 
1S7 








CROSS two* 
Supine: lifts legs wgn tn extension 
Poll-ln-il * no head lag 
an* nc* o <.cci» sieve/ 
Ventral Suspens: arm extend 
Prone: both elbows extended 
Stand: large fraction weight 
Stand; shoulder tone sustained 


17? 
173 
tin 
17S 
176' 
177 

1/n 

(/9 

inn 








GROSS I10TOR 
Supine: lifts head from platform 
Supine: rolls to prone 

■ u l| > — tit* lift* *-— - J 

rnii-to-sit: nits Head, assists I J§wj 
%".halr: trunk erect (*36w) 
Sit: well, leaning tit hands (*?6V) ' 
SUnd: bounces (•?«*) 


I5H 








rmr motor 4 

Cube: prrcarlnos ijF*tp*"(*24w) 








FIHC MOTOR 
Cube: palmar grasp (t?d*7 
Pellet: contacts, rakes with whole hand 
• («?IW) 

String: contacts, rakes with whole hind 
*•?*) 


1S9 








Vocalization: grunts "growls 


int 
i« 








IANGUM% 

Bird Call, Selling: "turns head 
expressive: displeasure by sound other 
than crying (•— ) 


160 
161 








rmcriAi-sociAt 

D.ftlng,Ra: moulTies (*20w) 
Social: discriminates strangers 


183 
IfH 

ms 

in? 
inn 








rCRSONAt-SOCIAl 
reeding: takes sol ids welT 
Social: creates Social contact 
Social! pushes wlhfr'i hand away {*•••) 
Playt grasps feet, supine 
Play: sits propped 30 minutes (*36w) 
Mirror: pats mirror Imago 
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cr «j x O 



20 Uceks 



3 G 



32 Uccks 



1R0 
190 
191 
192 
193 
191 
195 
19C 
19? 
190 

199 
200 
201 
202 
203 



701 

2or. 



20C 



207 

20R 
209 

210 



211 
212 
213 



ADAPTIV E 

Cube, Rcll: I -hand approach A grasp 
2nd Cube: grasps 1st, grasps ?nd 
2nd Cube: grasps 2~morc than momentarily 
3rd Cube: retains 2 a* 3rd presented 
Massed Cubes: grasps 2 more than momentarily 
Cup A Hissed Cubes: retains cube* grasps cup 
Cube, flcl 1 : Ring-String: transfers adeptly 
Cube* Dell: Ring-String: bangs 
Oc 1 1 : retains 

Ring-String: secures ring by string (*40w) 

T'ffgnNTTfiiT 

SU: sit* jrect about 1 minute 
Stand: stands hands held («32w) 
Pionc: pWots ( w 3Ph) 
Prone: assumes crncnlng posltfnn 
Prone: crawls or crcep-r.rawls (*3Gw) 



ruir. no low 

Cube: radial palmar grasp (*3f*#) 
Pellet: radial raking or unsuccessful 

Inferior scissors grasp (*32w) 
Strfnit: Inferior scissors grasp 



ujrawr.F. 

Vocalization: dh-afi-afi^oTi" oh«oh, not aaah 
C32w) 

Vocal Ration: mtn-mum-mtirt, crylnt) (*3F»w) 
Vocalization: single consnnant sounds- 
da, ha, ga 
Vocalization: Imitates sotnufs— cough,, 
tongue-click, razz 



PrRSOtlAL-SOr.fAl 
Play: feet to mouth, supine 
Play: persistent fur toys out of reach 
Play: bites A chews 
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ADAPTIVE 
2nd Cube: grasps 2 piolongedly • 
M.Cubcs: grasps 2 prolongcdly 
Cubes: hits, pushes cube with cube (*56w) 
Cup ft M.Cubcs: removes cube from cup 
Pellet ft Bottle: regards pellet If drops 
or thrown out 



CR OSS jjgjftj 
Sit: sits steady - ) 0 minutes 
Sit: leans forward, reelects (*36w) 
Stand: holds rail, full weight (MCw) 



flhjfjiwor 

Pellet: Inferior scissors grasp (*3Gw) 



iamguage 

Vncallzatlon: da^HTor equivalent as 

sound (*3Gw) 
Comprehension: responds to no-no, (one of 

vnlec (*40w) 
Comprehension: understands name; word not 

voice 

Communication: uses gesture 



PfR SOHAI -SOCIAL 
Feeding; feeds self c« •.:*-:*• 
Feeding: some »Uk from cup or glass 
Social: plays pcck-a-*»oo 
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i 

i 



SI 



'.I 

Is 

1 



36 Hecks 



230 
231 
232 



233 
23* 
23S 
230 
237 
23fl 



239 
240 



211 
242 
243 



244 

245 



3 8 

rr o 



40 Hecks 



Cup ft Cubrs: hlts~cuhe against cup (*41*») 
Pellet: Index flmjcr approach 
Pellet ft Bottle: holds dottle* grasps 
pellet (*52w) 



nnoss »onm 

Sit: Indefinitely ste^Ty" 

Sit: to prone with case 

Prone: creeps on hands ft knees (*S6h) 

Prone: to fitting 

Stand: pulls to left at rail (*S2w) 
Rail: lifts, replaces Toot (*S?w) 



ri«C "010R 
Cube: radial digital grasp 
Pellet: scissors grasp (MOw) 



Vocabulary: any 1 = wortP 
Vocalization: ma-m* as sound (*44w) 
Vocal Uat Ion: sings along with music 



rCRSMlA l-SorjAL 
feeding: holds own hut tie (*21i>) 
Social: Imitates Z nursery tricks 



24/ 

2*1 
240 
250 
751 



26? 
261 

;*.5 



m 



nOAPTIVE 
Cubes: matches Z cuhcs~(*50w) . 
Pellet ft 9ott1e: points at pellet through 

glass (M5m) 
Hell: grasps by handle 
Rcll: pokes at clappei 
ncll: waves 

Mng-Strlfwj: sees connection, pulls String 



GROSS 110 f OH 
Rail: cruises, using Z hands (M4u) 
Rail: retrieves toy from floor (*S2w) 
Rail: lets self down with control 



MHI HOTOR 
Pellet: grasps promptly 
Pellet: Inferior plnccr grasp (Mow) 
String: scissors grasp (MOw) 



twiwwc 

Vocabulary: da-da" with meaning 
Vocabulary: any Z "words" 
Comprehension: perfoims 1 nursery trick i 

verbal request 
Comprehension: responds to no-no, word 



PSRSPHAL-SOClAl 
Social: Imitates 3 nursery tricks 
Social: extends toy, no release (*44w) 
P!«y: toys to side rail or platform (*S?w) 
Dress: pushes arms through If started 
(♦30*) 
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APPENDIX C 
PARENT RATING FORM 
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PARENT RATING FORM 



Name: _ IOf . ^ ■ 

Instructions: 

^ fo )J° win 9 questionnaire contains questions about things your child can do and 

Y£S: ?? tt SNfi^ttt the " t1v1ty " wel1 or btttftr - thtn 5t 

For example, if the question asks for three different word* and your 
child uses five different words, check YES. 

USED TO: Means that your child has shown the behavior in the past, but hex 
outgrown it or now uses e more advanced behavior in its piece* 

For example, if your child uses one hand to reach end grasp, but 
useo two hands a few months ago, answer the question etout reechino 
with two hands by checking USED TO. reecmns 

SOMETIMES: Keens that your child is just starting to do the activity, does not 
tion ttkt r V6ry ° fteni ° r d0CS not d0 U e " ct1 ' w ^rjues- 



NOT YET: 



For example, if your child has followed a two step direction once 
or twice, but usually needs, help, check SOMETIMES. 

Means that your child does not do the activity as asked in the 
question. If you ere not sure your child can do soroe of the acti- 
vities, try those activities with your child. 
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PARENT RATlifc FORM 
FineMotor 



YES 



u 
o 



o © 

&. u 
o o 



USED 
TO 



i 



.5^ 



v. e 
© o 



SOME- 
TIMES 



> © 



{ So 



18 



NOT 
YET 



2-2 



Si5 



l. 

2. 
3. 



8. 



10. 



Dees your chile put 2 smell object cn another smell object, 
balancing it correctly before letting go (e.o., a block on a 
block)? 

Does your child pass an object from one hand to the other hand? 

Using the tip of the thumb and one finoer without resting her/Ms 
arm or hand cn the table, docs your child pick up a peilet-sized 
object [e.g., cheerio, raisin)? 

tenV^S!' r " Ch 0Ut 6nd t0UCh {0r ***** °« ect us ^9 both 

Does your child use a turning motion with both the left end rioht 
wnsw while manipulating an object (e.g., turns doorknobs, wind 
toys, dials, twists jar lids)? 

While holding an object in each nan* (e.g., blocks, spoons), dees 
your child bang the objects together? 

Does ycur child put together at least two different simple three- 
four piece interlocking (pieces that fit~together) puzzles? 

After you draw simple shapes (e.g., circle, cross, scuere), does 
ycur child copy at least two different shapes? " 

S S n tSIII c^ ld , mCh " ro ? s his/her body to get an object on 
.he o.her side (e.g., use left arm to get a toy on the right)? 

Using one or the other hand, does your child brino objects to 
his/her nouth? 



ERIC 



87 







YES 


USED 
TO 


SOME- 
TIMES 


KOT 
YET 








•» 
e 


•ft 

J 






PAR P NT PtTTMft Pr.DM 

Gross Motor 


o 

> 
m 

£ 
a 

JS 


JS. 

JSl 


o 

> o 

25 
3° 


• 

*»> 

if 
£ 






Performs the 
correctly 


Did perform i 
but doesn't < 


S* 

? ■ 5 
t JS 


a. 

u 
o o 

> 

il 


1. 


Keeping stcnach off the ground, does your child creep forward et 
nT^pfosUe ?J fi ) 1 ? temtiR9 dnd le5S (e ' 5 " ^ on < * r * 










2. 
3. 


Does your child roll over from back to stomach end stomach to 
back, getting both arms out from under the body"F~ 

y *U r C ^ ild n0ve hsr/his inns » 1c 9 s ' ind h « d separately frca 
each other (e.g., wave arms, kick legs, turn head)? 








— 


4. 
5. 


chair" 1 y ° Ur Ch11d Climb 1n ftnd 0ut of ' ch11d size 

Without help, does your child get to a sitting position on the 
floor from lying down, hands and knees, or stanoing? 








— 


6. 


Does your child walk unsupported with body uprioht, swinefno trrs 
reciprocally (e.g., swings right arm forward as'left leo'moves 
.orwo enG swings left arm forward as rignt leg moves forwerd)? 










7. 


While standing and without supoort, does your child bend at the 
waist (or squat) to reach an object on the floor? 








— 


S. 
o # 


Does your child dinb up and down ladders (e.g., slide, junole 

gym)? 

Using either foot, does your child hop on one foot at least one 










10. 


Does your child avoid obstacles while runnino (e.o., runs around 
a wagon)? 










11. 


Does your child pedal and steer a tricycle forward at least five 
feet? -— 











88 





YES 


USED 
TO 


SOME- 
TIMES 


KOT 
YET 


• 


u 
0 


* 
u 
0 

> 
m 


«* 

I 




PARENT RATING FORM 


*> 

«8 


0 t- 


0 

> «l 


0 


Self Cere 


JZ 
O 
JD 


il 


2° 


c 




V 






0 




** 

*« 


E- 

0 c 


a 10 

m 


u 

& 




its 


*!■ " 
u 0 
0 0 


Bio 


0 0 

c— . 




VcrU 
corn 




Pcrfc 
some! 
does 


> 


1. Without help, does your child use ft spoon end fork when eating? 












2. Witncut help, does vour child usuelly drink from i cup or oless 








— mmm 


3. Dees your child Mte off end chew a piece of herd-to-bite food 
ttdm 5 urctr piece o» 1000 ( e . 9 • • apple, neat, hero cookie/? 










<. Does ycur child nove her/his tongue up end down or side to side 
in the mouth (e.g., move food around in the mouth, or follow ft 
toothbrush with the tongue)? 










5. Without help, does your child pour liquids from one container to 
enother container without spilling (e.g., pours juice from 1 
pitcher into e cup)? 










£. Does your child use the toilet without help (walks to toilet, 
adjusts clothing, eliminates in toilet, and flushes toilet)? 


















_ 


/. uoes your cn»ic 00 an ot tne following: without help - weshcs 
face and hands, drys face end hands, oets tissue and cleens nose 
with helo - brushes teeth end brushes hair? 










8. Without help, does your child put on end take off her/his clothe) 
inducing fastener: (buttons, snaps, eno 2ippersJ, clothing 
items, and shoes and socks? 
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PARENT RATING FORM^ 
Cognitive 



YES 



2 



S3 

e o 
»*- L. 

5 c 



USED 
TO 



o c 

V O 
CI o 

Si 



some- 

TIMES 



O 

> O 

25 



lis 

o 

1r 8 4/1 

w I a 
o 8 o 



NOT 
YET 



5 

£ 

U 

o o 
> 



I 



1. Does your child respond to sounds (e.g., looks in direction of 
sounds), to objects and people (e.g., follows a mobile, looks 
at objects), and to touch (e.g., pulls hands away from rough 
things, plays with water)? 

2. .Does your child look for toys and/or people where she/he usuallv 

finds them (e.g., goes to toy box to look for a toy, coes to 
crib to get blanket)? 

3. Dees your child follow toys and/or oeople with her/his eyes 
until they disappear from view? 

4. Does your child approximately imitate new words and motor actions 
(e.g., says, "gog" for dog, waves arms in circle after you do 
it)? 

. After you wind a mechanical toy (e.o., Jack-in-the-box, wind-uo 
radio), does your child try to work the toy like vou did (e.g., 
tries to turn knob, push button)? 

6. After you stop playing an action game (e.g., peek-a-boo, bounc- 
ing child on knee), does your child use an action that was part 
of the game to get you to keep playing the game? 

7. Does your child try at least two different ways to solve a sin- 
pie problem (e.g., tries to get something from a counter by jump 
ing up to reach the counter, calls for cr oets an adult, and/or 
Dulls Chair to counter!? 



10. 



11. 



ing up . w.w, W v W „ 
pulls chair to counter)? 

When playing, does your child use an imaginary toy/object (e.g., 
holds hand. to ear and pretends to be talking into a phone, ore- 
tends to eat food from an empty bowl)? 

Does your child play with or use toys or objects as they are 
supposed to be used (e.g., holds play phone to ear)? 

When given a group of different objects, does your child put 
objects together that go together (e.g., spoon and bowl; comb 
and brush; shoes and socks)? 

When you show your child a picture that matches one picture in a 
group of 3 or'4 pictures, does your child pick up or point to 
the one picture in the group that matches? 
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PARENT RATING FORM 
Communication 



YES 



mm. 

© 



o 



EtJ 

C © 



USED 
TO 



o 



it 



E~ 

u o 
o o 



q.5 



SOME- 
TIKES 



L. HI 

e 

> o 



o e 

gig 



KOT 
YET 



E 

O 



im. 

> 

in m 
© «c 

55 



10. 



n. 



Does your child look at ycu (or other adult) then point to t tdv 
or object end then look at you again, while mTkuTg sounds? 

Does your child ntke 2 or more consecutive vocal exchanoes with 
others (e.g., child says, "to fed", adult savs, "ball", and child 
says, "ba M l? 

Does your child turn away from what she/he is doing to look tt 
something' an adult is looking at or pointing at (e.g., while 
playing, the adult turns and looks at the window and the child 
turns and looks at the window)? 

Does your child turn to look at someone who .is talking (e.g., 
while playing, the child looks at the adult when the adult 
speaks)? 

Does your child follow two-stes directions that do not relate to 
the immediate situation le.g,, when doll is not close, the adult 
asks the cnild "to get the doll and put it on the bed")? 

Wren you ask ycur child to show you at least 20 new pictures of 
corrr.on things, does your child show you (point to, look at, 
touch) the picture 

When speaking in sentences, does your child end 2 or more words 
with 's, s, or ing in one sentence (e.g., "girls are runninc", 
"the boy£ have hatsj? 

Does vour child use three- word sentences at least 3CS of the 
tine (e.g., "mama open coor", "me roll truck")? 

Does your child use 3 different relational words (more, there, 
want) with 5 or more~different labels (e.o., "there kitty", 
"more juice~, "all gone bubbles")? 

Does your child use at least 10 different two-word sentences 
that include at least one of each of the following: 

a. a person and an action (e.g., "ttarcria eat") 

b. an action with an object (e.g., "roll ball") and 
c a person and an object (e.g., "Daddy truck") 

Does your child use at least 60 different words appropriately 
(e.g., says', "ball" when playing with a ball, looking at picture 
of a ball, looking for a ball)? 
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Conmunication, Continued 


YES 


USED 
TO 


SOME- 
TIMES 


NOT 
YET 


12. Does your child consistently use word approximations for certeit 
objects, people, end/or when asking for things, protesting, and 
answering questions (e.g., always says, "ju" for juice)? 











PARENT RATING FORK 
Socle! 



YES 



t> o 



USED 
TO 



o o 



S3 



Does your child follow simple directions if civen to her/him 
alone end if given to * oroup of children (e*o. f "Sara, put your 
toys away"; "let's ell 90 outside")? 

Does your child use appropriate behaviors in many different deil 
. routines (e.g.. cones to table at mealtime, undresses at bath- 
tine, plays with toys at playtime)? 

Does your child talk to or play with adults (ste-ts interactions 
wu " *cults end responds to interactions from adults)? 

Does your child talk to or play with friends (starts interaction 
wuh friends arvrf responds to interactions from friends)? 

Does vour child plev with nanv different tovs or objects? 



SOKE- 
TIKES] 

I 



> W 

2° 



nor 

YET 



5 



o 

a. 



£3 c 



£8-8 



OO 

ss 
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APPENDIX D 

SELECTED PAGES FROM THE DEVELOPMENTAL 
PROFILE II ADMINISTRATION MANUAL 
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DEVELOPMENTAL PROFILE II 
INTRODUCTION AND OVERVIEW 

The D€velopmental>ronif His an irrventory of skills designed^ 
through age nine, a comprehensive assessment of a child's development typically has required exaenstv* 
and fime-consummg examinations by a variety of expens in the areas of motor, language, Dtrsonal/MrZ 
help, social and intellectual devetopmem. The present inventory, in contrast, provides a rettattti assessment 
expert ,heSt key artW in 20 10 40 mimrtW by an tva,ua,or nM 001 * » ***** eevetopmeweJ 

The inventor provides an indrviu:*! profile which depicts a child's functional devetoprnental-aoe tart 
by cassifying panicular skills accord^ to age norms in the live areas of development These are briefly 
described below: 1 

PhysicaJAge This scale measures physical development s>y determining sb*t*s with tasks 
requiring large and small muscle coorcmation. strength, stamina, tlexibrtrty arc 
sequennal motor skills. ' 

Self-Kelp Age This scale measures the ability to cope independently with the envfcorimem and 
measures the child's skills with tasted 

assesses the degree to which children are capable of responsibly ctrmofer them- 
selves and others. ' 

Social Age This scale measures interpersonal relationship abilities. The child's emotional needs 
for people, as well as the manner in which the child relates to friends, relatives snd 
various adults exemplify the skills which measure functional performance in the soda! 

sduaiton. 

Academic Age This scale measures intellectual abilities by assessing, atthe younger preschool 
level, tne development of skills prerequisite to scholastic functioning and. art older 
pre-scnool and school age levels, actual academic achievement 

CornmunicEtton Age This scale measures expressive and receptive communication skills with both verbal 
and non-verbal language. The use and understanding of spoken, wrtoen and 
gesture languages are assessed by this scale. 

The administration of the Developmental Profile involves determining whether the child does or does not 
have skiIIs listed m the inventory. Determining what the child can do and/or does do a*ows corrtparison of 
those individual abilities to normative data. i.e.. the specific age at which children usually master each skill 
the ^mCento^ ,&n!,y we,, ' 8cquaimed w,,n ,he Mn P r0vk!e ''"formation necessary to answer questions in 

A. Functions of the Profile 

The Developmental Profile can be used to accomplish a variety of assessment and educational 
objectives, each of wnich is valid and appropriate. The instrument can be used to deterrr.** 
eligibly for receiving special education and/or related services; as a planning tool to develop an 
individualized educational program (IEP) consistent with me child's strengths and deficits- as a 
measure of child progress by compering Profile scores at the beginning of the school \w tore-test) 
with scores achieved at the end of the school year (post test): and as a method tf enalustfno an 
en.ire educational program or service by comparing the average pre-test scores o! a oroup of 
cni.dren. i.e. a classroom, with the average post-test scores of the same group. Also, saice the 
Development! Profile provides & rapid and accurate measure oi development along 5 dimensions 
it can oa used as a component in periodic deveiomental screening programs conduced bv heafth 
practitioners. Child Find programs or paients themselves. conoucec py nearm 

with^ecr tesita ™ nUI Pf ° n,e T * U * tiy 8dmini51ered so)tl y as * n ^erview or in combinaiion 

Any or all five scales may be used reliably. When all five scales are utilized the invereory usuaftv 
requires approximately 20 to 40 minutes to administer and score. 
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B. Goals 

Four major goals guidtd the construction of the Developmental Profile: 

Goal 1 : To offer an instrument which provides a muliioim*n*-J6net description of children's develop* 
menu 
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Most developmental assessment tnstn>* vHs ; . e single-value depid*on of the child's -V? 
development, e.g.. intelLgence, perce^ai-moter, or language. At best, such instruments 
allow for some type of sub-scale ^«iyses; but these are usuaty interprets!* only by ^ 



"experts" and they still measure % d repon on a limited area of the child's overall growth and 
functioning. The very existence of so many different tools for assessing different areas 
demonstrates that a child's development proceeds along more than one dimension. An 
instrument which measures functioning in 5 areas of growth and development provides users 
with a multidimensional view of the child— a view considered to be more accurate and 
functional than single-value captation. 
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Goal 2: 'To provide an inventor)' which has no significant bias as a function of the sex, race, snd social ^ 
class oi the children being evaluated*. >h 

There has been much justifiable concern about the applicability of the major developmen- 
tal tests to various minority groups. The most well-known illustration involves discrimination 
against blacks perpetrated by the inappropriate use oi tests primarily standardized on middle* 
class whites. A major goal oi t he Developmental Profile was to rrunimfee any poss&Siry that it 
could be misused in any manner which would discriminate against children as a function oi 
their sex, race, or social class. 

Goal 3: To provide a relatively quick, inexpensive, out accurate description of a child's development 

The justification for developing an inventory that was economical in terms of time and 
money is seh-evieen!. The need lor accuacy was specifically aniculated to establish that the 
ease and scope of the instrument would not be accomplished at the expense oi high degree of 
validity and reliability. 

Goei4: To permit the administration, scoring and interpretation of the instrument by people who do not 
have specific expertise :n psychological testing. 

There are many stations when a developmental assessment would be useful, yet it does 
no*, occur because tne use ci expens is too expensive, time consuming, or they simply are not 
available. An instrument which provioes an accurate measure a child's development m 
arelativeiy shen period of t:me: an instrument that can be administered by professoneis and 
para-professionals, teachers, teacher aides, physicians, nurses, social workers, mecical 
aides as well as psychologists anc psychometrists— should aDow for more accurate assess- 
ments in thai vane:y of settings where they are neecec and appropriate but essentially 
unavailable. 

The oegree to which each of these goals was achieved is more precisely described m later sections. 
It is hopeo that all users oi the Developmental Prolile will take tne time to acquam: themselves with the 
standardization, construction, reliability and validity data. Only with such knowledge can this or any 
other assessment instrument be appropnately used. 

C. Instrument Description 

The Developmental Prolile H consists of 156 items arranged into trve scales. An scales have items 
arranged into age levels the age levels proceed at 6-month intervals from bmh to 3 1 2 years and proceed 
thereafter by year intervals. Table I presents the descriptive name, age range, anc ace-range 
micpotnt for each ace interval Note that the year intervals describe crvidren 6 months on both s*ees of 
the year norms (e g.. 6 year level covers ages 5 1 2 years to 6\? years). 



PROFILE SHEET 



Child's Name:. 



Physical 
Age 



SclMlclp 
Ago 



Social 
Ago 



Academic 
Age 



Communication 
Ago 



Months Advanced 



Chronological Age: . 



yrs. mos. 



Months Delayed 



+40 
+AA 
+40 
+3G 
1^32 
+20 
+24 
+20 
+ 10 
+ 16 
+ H 
+ 12 

no 

»0 

^6 
AA 
12 

-2 

-4 

-6 

-0 

-10 

-12 

- H 

-16 

-10 

-20 

-2*1 

-20 

-32 

-36 

-AO 

-*M 

-HO 



For Rcforrai Guidolinos Soo Manual: 



Tnblo IV 



TabloV 



TabloVI 



Tabic VII 



Table VIII 
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PHYSICAL DEVELOPMENTAL AGE SCALE 



First Va Year (Newborn: 0-6 months) 

P 1 . When the child is lying on its stomach, does the child hold its head op, without support, tor at 
least one minute? 

P 2. Can the child roll from its stomach tc ris back and from back to stomach without help? 

P 3. Does the child have any method of getting from one place to another? Creeping (stomach 
touching the floor) or crawling (stomach ott The floor) in any fashion (except rolling) that permits 
forward :ravel is acceptable. 



Second V? Year (Infant I: 7-12 months) 

P 4. Does the child use a thumb and one cr two fingers to pick-up something (this is a pass), or is the 
cbject grasped with the whcie hand (inis-method is a tail)? 

P 5. Does the child go from a crawling c sitting position to a standing position?' The child may use 
something lor help but not someone. 

P 6. - Has she child stopped drooling? (Tnis item is passed if no eroding occurs except when chew- 
ing, teething or eating.) 



1 to V/2 Years (Infant II: 13-18 months) 

P 7. Does the child walk up stairs (upright, not crawling) using a wall, hand rail or a person's hand lor 
support? Putting both feet on each step rates a pass. 

P 8. Dees the ch:!o wa!k well enough, without support, to go about the house unwatched without 
falling or bumping into objects? 

P 9. Does the child take the paper off candy bars or gum or any other wrapped ob}ect? 



1Vi to2 Years (Toddler I: 19-24 months) 

P 10 Does the child pitch, toss, or fling objects for a distance of at feast three feet in a direction s-'he 
wants 7 Just throwing thmcs which go in any direction ooes not rate a pass. 

P 1 1 . Does the child go upstairs taking one stair with each foot? The child must alternate feet going 
upstairs b*>t may still be putting two feet on each step going downstairs. 

P 12. Does the cr 3 ride a 3- wheeler (tricycle or "Big Wheel") using the pedals for at least 10 fee; and 
turning wide corners 9 



2 to 2Vi Years (Toddler II: 25-30 months) 

P 13. If you were to draw an up and down straight line, could the child copy it using a pencil, crayon, or 
paintbrush? The question is whether the child has enough eye-hand coordination to copy a tine 
instead of ;ust scribbling. 

P 14. Does the child jump without falling, with both feet together, t om any object which is at least 
eight inches off the floor (such as a step or box)? 

P 15. Can the child move from place to place by jumping or leaping with two feet together? The child 
must be able to go at least 10 feet in this manner. 
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PHYSICAL SCALE 



2% 1,0 3 Years (Toddler III; 31-36 months) 

, P 16. Docs ihe child use a scissors whh one hand lo cut paper or cloih? The other hand can be used 
!o ho!d the paper or cloth, or the material can be held ior the child. The child must be able to use 
the scissors to cut rather than to merely tear. 

P 17. Can the child hop forward on one foot without support for a distance of at least five feet? 

P 18. Does the child usually walk upstairs and downstairs by placing only one foot on each stair? 
S/he may use a railing c wall but this should not be necessary for ordinary support or balance. 



3 to 3^ Years (Pre-schooler I: 37-52 months) 

P 19. Can the child throw a ball {sny size) tp an adult v/ho is standing five feet away? The adutt must 
be able to catch the ball without having to move. 

P 20. Does the child release the latch and open an inside door? The child must be able, for instance, 
to twist a doorknob and push open an unlocked bathroom door. 

P 21 . Can the ch:!d use a scissors lo cut oyt a printed circle Ihe sire of a silver collar without te:r.c off 
more than a puaner o! an men anywhere? The child must hole and turn the paper with one hand 
while cutting with the other. 



4 Years (Pre«schoaier II: 43-64 months) 

P 22. Does the chiid catch a ball (any size) thrown by an adult who is standing five feet away? The 
child must catch the ball 50% of the time. 

P 23. Can the child hop forward on one foot for a distanre of at least 10 feet without having to stop and 
start again? 

P24. Does the child jump rcpe with one o f both feet at least twice; or can the child jump over a 
number of things in its path without stepping? The "things" should be at least eight inches high. 



5 Years (Pre-schooler III: 55-66 months) 

P 25. Can the child use a key to open and unlock a small padlock? 

P 26. Can the child make a snowball cr mud bail solid enouoh to stay together when thrown at least 
eich; feet? 0:her material such as p!ay«dough or set iay coulo also be used. The ability to 
throw the material eight feet is also necessary to rate a , 'ss. 

h 27. Does the child play hopscotch or a similar came requiring skilled hopping? This includes being 
able to hop on one toot into a markec spot without falling, hop, turn around and continue the 
hopping. 
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PHYSICAL SCALE 



6 Yesrs (Primary Elementary I: 67-78 months) 

P 28. Does the child roller skate, skateboard or ice skate' Skatino means the child can push and 
glide with one foot after the other. There can be occasional fa.is but most of the time the chi'd 
can travel at least 10 feet without falling. 

P 29. Can the child cut out a four inch picture of an animal or human without being more than a cuafier 
of an inch off anywhere? 

P 30. Does the child skip rope? The child must be able to hold both ends ot « jump rope and skip, hop 
or jump three times in a row while flipping the rope over the head and unoer the feet 



7 Years (Pumary Elementary II: 75-90 months) 

P 3 1 . Can the- child pick up and carry a kitchen or dining-room chair from one room to another? 

P 32. Can the child run fast enough to compete wijh a normal (non»handicepped) eiohvyear old child 
in a race or game of tag? 

P 33. Can the child cstch a tennis size bait with one hand when thrown gently from at least she feet 
away? (The child must catch it at least 50% of the time.) 



8 Years (Primary Elements, y III: 91-102 months) 

P 34. Can the chilo strike and light a paper maich? The child must be able*)' licht the mate* within 
four tries. (N'ole: if this hem is consicereo naopropnate. use only P 35 and P 36 for this level 
and assign 6 months credit for each of these hems.) 

P 35. Can the child use a house key to unlock and cpen a typical front or back door ot a house? 

P 36. Can the child wink either eye on request without closing the other eye? 



9 Years (Upper Elementary I: 103-1 14 months) 

P 37. Can the child whistle a recognizable tune? 

P38. Does the child compete in sports, such as baseball, soccer. vo»eybaS. irack. etc.. wrtti rher 
children 10 to 11 years ot age and demonstrate at least as much sktt2s most samesexed 
chilcen m the same group 7 

P 39. Does the child have sufficient skill to nde a bicycle on a main street or thoroughfare in moderate 
traffic? 
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APPENDIX E 
SCORING DECISION RULES 
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CiiPZ SCORING DECISION RULES 



Scores for each Item are recorded 1n the score boxes on the data recording 
forms. Codes (defined later) that explain certain scores arc recorded 
In the "notes- column to the right of the data recording boxes. Only one 
score should be recorded for each Item, 

Items will be scored either: pass (+) or fall (-). An item is scored 
pass if a child performs a behavior correctly and Independently. An 
Item Is scored fall If a child does not perform a behavior or requires 
complete physical assistance to perform a behavior. 

The criterion for acceptable performance (pass score) Is different for 
different domains. Refer to the Administration Manual for specific 
criteria for each domain. 

If there Is no opportunity to see a particular behavior score the 
particular Item (fail) in the data score box and record *H9* (no 
opportunity) in the notes column. However do not score "NO* for thos* 
Items beyond the child's capability or developmental level. These Items 
are scored H - M (fail) and "HL M (higher level) and are recorded 1n the notes 



Each domain is divided into several strands that represent groups of 
related behaviors, witrtin each strand items are arranged into long- 
Range Goals (IRG) and Training Objectives (TO). Son* strands and 
items within strands are developmental 1y sequenced* others are not. 
Following are guidelines pertaining to scoring sequenced items and 
other scoring situations. 



column. 




J v £"C" 'ff- ***** i* w 



TO 

1.1 
1 2 

1.1 
1.2 



1.1 
1.2 



1.1 
1.2 



1.1 
1.2 

1.1 
1.2 



Score Box 

□ 

□ 
□ 

□ 
□ 
□ 

□ 
□ 
□ 

□ 
□ 
□ 

□ 



Notes 

CD 
ZD 
ZD 

ZD 
ZD 
ZD 

ED 

m 

ZD 

m 
m 

Ed 

[ED 
03 



When Items are arranged in a sequence and thr 
TG 1s scored pass the TOs under thi TG are 
scored pass by drawing an arrow through the 
score boxes. The arw Indicates the items 
were assumed to be passed. 

When a TG is scored fail then the T0$ under 
the TG must be scored. Score each item 
(no arrows). 



When there 1s no opportunity to see particular 
behavior and score the TG, score (fall) in 
the score box and record "NO" in the notes 
column. 



When there 1s no opportunity to see the 
behaviors relating to the TOs score (fall] 
1n the score box and record "NO" in the notes 
column. 



Depending on the age and developmental level 
of the child, some strends might assess 
behaviors beyond the capabilities of the child 
Score these items fail end record "HI" (hlcher 
level) in the notes column. 

.Some Items will no longer be relevant for the 
ch Id (e.g., an older child/higher functioning 
child). Score these items pass and record "NA" 
(not applicable) in the notes column. 
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APPENDIX F 
CEEPS EVALUATION FORM 
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The Comprehensive Early Evaluation and Programming System (CEEPS) 
Evaluation Questionnaire 

Name: . 

UTILITY 

In cenersl, how long does it take to administer (observation, direct test, < 
parent report) the CEEPS to one child? 

In general, does the CEEPS provide enough/appropriate infonwtion to design 
intervention programs? 

FORMAT 

Suggestions for format changes: 
Data Collection Forms 

Acmir.istration Guide (Introduction) 

Administration I'anual (Target/Item Pages) 



Other 



CLARITY 



APPROPRIATENESS 



Guidelines: 

Are there any confusing words, phrases, 
sentences? What changes should be made? 

Items Cri teria Pi recti ons 



Guidelines: 

Is it clear what behaviors the items are 
measuring? Are the criteria ^ppropriate? 
Are the directions complete? What 
changes should be made? 

Items Criteria Directions 
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